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I INTRODUCTION 


A.  Background 

The  David  W.  Taylor  Naval  Ship  Research  and  Development  Center 
(DTNSRDC)  is  the  lead  laboratory  for  naval  logistics.  In  addition,  the 
Technical  Strategist  for  Logistics  and  Facilities  is  located  there.  It  is 
the  task  of  the  Technical  Strategist  to  develop  and  maintain  an  overall 
technical  strategy  to  focus  the  thrust  of  all  exploratory  development 
(ED)  in  the  field  of  naval  logistics  (certain  specific  logistic  functions 
are  assigned  to  other  technical  strategists).  This  approach  to  planning 
ED  is  innovative,  especially  for  the  area  of  naval  logistics. 

Naval  logistics  is  heterogeneous,  comprising  a wide  variety  of  very 
different  and  quite  technical  functions.  These  functions  require  differ- 
ent expertise,  employ  different  technologies,  and  are  evaluated  by  dif- 
ferent measures  of  effectiveness.  As  a result,  at  the  supporting  estab- 
lishment level  (where  most  research  and  development  is  conducted),  naval 
logistics  has  been  largely  planned,  managed,  and  conducted  in  separate 
functional  areas  by  separate  agencies — e.g.,  Naval  Supply  Systems  Command 
or  Naval  Sea  Systems  Command.  For  the  most  part,  ED  has  been  conducted 
according  to  the  needs  felt  within  each  functional  area  with  only  broad- 
brush coordination  among  functional  areas. 

However,  the  Technical  Strategist  for  Logistics  is  required  to  view 
naval  logistics  as  a whole.  He  is  to  identify  the  regions  of  needed  im- 
provement, the  pertinent  emerging  technologies  to  meet  these  needs,  and 
the  potential  payoff  in  ED  of  technologies  to  meet  the  needs.  Then  he 
must  recommend,  from  the  alternative  combinations  of  separate  functional 
area  ED  programs,  the  integrated  program  that  will  result  in  the  greatest 
benefit  to  overall  naval  logistics  system  effectiveness  for  the  budget 
available  for  ED  of  logistics. 


Much  work  remains  to  be  done  before  the  process  of  developing  and 
maintaining  a technical  strategy  for  logistics  is  perfected.  A pressing 
near-term  requirement  is  a methodology  for  allocating  ED  resources  among 
and  within  the  key  areas.  A longer-term  requirement  is  the  development 
of  a method  to  model  the  overall  naval  logistics  system  in  order  to  mea- 
sure the  impact  of  changes  in  elements  of  the  logistics  system  on  fleet 
readiness  or  total  system  costs. 

These  two  requirements  are  related.  Proper  allocation  of  the  ED 
funds  requires  the  knowledge  of  measures  of  effectiveness  (MOEs)  for  the 
logistics  system,  and  these  MOEs  are  derived  from  the  different  steps  re- 
quired to  model  the  overall  naval  logistics  system. 

Key  tasks  associated  with  resource  allocation  method  are  developing 
meaningful  and  useful  MOEs  and  establishing  explicit  or  implicit  rela- 
tionships (where  they  exist)  among  the  various  MOEs  to  better  understand 
their  impact  on  overall  effectiveness;  and  developing  a method  of  ED  re- 
source allocation  for  trading  off  the  expected  achievable  levels  of  the 
MOEs  that  characterize  each  program. 

B.  The  Problem 

1.  Measures  of  Effectiveness 

In  each  functional  area  of  logistics,  different  MOEs  have  been  de- 
fined to  measure  different  aspects  of  performance--e.g. , in  the  supply 
system,  one  MOE  for  operational  performance  is  requisition  fill  rate, 
and  for  financial  performance,  one  MOE  is  the  ratio  of  sales  to  value  of 
inventory.  These  are  valid  MOEs  from  the  viewpoint  of  a supply  officer 
at  a supply  depot.  Different  but  related  MOEs  will  be  of  concern  to  the 
user,  such  as  an  operational  commander.  He  will  be  primarily  concerned 
with  the  response  time  for  the  system  to  supply  him  with  a certain  type 
of  part  or  quantity  of  material.  This  response  time  will  be  a function 
of,  among  other  functional  MOEs,  the  requisition  fill  rate  mentioned 
above.  Thus,  no  simple  MOE  is  now,  or  may  ever  be,  available  to  measure 
all  important  aspects  of  effectiveness  for  an  entire  functional  area, 
and  in  some  cases  the  MOEs  used  may  be  mutually  conflicting. 
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Among  different  functional  areas — e.g.,  the  supply  system  and  the 
maintenance  system--the  relationships  between  MOEs  is  even  more  ill- 
defined.  Finally,  in  the  overall  system  the  interplay  among  different 
functional  MOEs  and  their  cumulative  effect  on  the  evaluation  of  the 
overall  system  effectiveness  are  only  poorly  defined. 

2.  Resource  Allocation  for  Exploratory  Development 

Currently  the  methods  of  arriving  at  the  ED  resource  allocation  de- 
cisions within  the  relatively  short  deadlines  imposed  by  budget  schedules 
depend  mainly  on  judgment,  experience,  and  intuition.  Without  a formal 
method  for  allocating  ED  resources  among  the  heterogeneous  key  areas  of 
logistics,  the  decisions  are  difficult  to  make  and  the  rationale  followed 
in  the  selection  may  be  hard  to  reconstruct. 

The  difficulty  lies  in  the  fact  that  each  key-area  technology  program 
is  characterized  by  a set  of  expected  achievable  levels  of  different  but 
important  MOEs.  Each  of  these  characteristics  or  attributes  measures  a 
different  type  of  effectiveness,  and  they  cannot  now  be  objectively  and 
quantitatively  traded  off  to  determine  the  preferred  program  or  the  order 
of  preference  of  other  programs.  A subjective  methodology  is  required, 
which  is  based  on  judgmental  inputs  by  decision-makers. 

C.  Research  Objectives 

The  research  reported  herein  was  undertaken  to  provide  an  initial 
attack  on  these  key  resource  allocation  problems.  Due  to  the  complexity 
of  the  naval  logistics  system,  the  research  focused  on  one  key  technical 
area--the  supply  system.  However,  the  results  should  provide  a basis 
for  the  development  of  models  for  each  of  the  technical  areas  (and  in  the 
longer  term  for  the  overall  naval  logistics  system)  and  for  the  establish- 
ment of  resource  allocation  decision  procedures. 

The  primary  objectives  of  this  research  were: 

(1)  Identification  and  development  of  measures  of  effective- 
ness (MOEs)  models  for  one  key  logistics  technical  area. 
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(2)  Development  of  a general  resource  allocation  (RA)  method 
for  multi-attribute  (i.e.,  disparate  MOEs)  outcome  prob- 
lems. 

(3)  Application  of  the  RA  method  developed  in  Item  2 to  a 
sample  problem  in  the  technical  area  considered  in  Item  1. 
This  sample  problem  will  be  based  on  realistic  budget 
levels  and  ED  program  alternatives. 


II  SUMMARY  AND  CONCLUSIONS 


A.  Summary 


A method  for  decision  making  in  the  allocation  of  funds  for  explora- 
tory development  (ED)  programs  was  developed  to  specifically  address  the 
question  of  how  to  compare  alternatives  whose  expected  outcomes  are 
multifaceted.  The  multifaceted  aspect  of  the  problem  results  from  the 
fact  that  there  is  no  single  measure  of  effectiveness  that  can  be  used 
to  judge  the  benefits  of  the  many  diverse  technical  functions  comprising 
the  logistic  area.  A decision  maker  (DM)  is  then  faced  with  the  problem 
of  determining  how  different  MOEs  should  be  traded  off  to  arrive  at  the 
most  beneficial  combination  of  expected  outcomes. 

The  method  relies  heavily  on  the  subjective  but  informed  judgment 
of  a DM.  It  assumes  that  the  DM  has  a subjective  model  relating  the 
needs  of  the  Navy  to  fulfill  its  mission,  the  various  logistics  MOEs 
that  relate  to  the  Navy's  capability  to  carry  out  this  mission,  and  the 
relative  effects  of  improvements  in  these  MOEs  on  this  capability.  The 
method  allows  the  DM  to  progressively  build  up  and  communicate  his 
preferences  concerning  specific  ED  programs  and  their  expected  outcomes 
expressed  as  achievable  levels  of  important  MOEs.  He  does  this  through 
a sequence  of  MOE  tradeoff  assessments  between  two  alternatives  that 
differ  only  in  the  values  of  two  MOEs.  These  tradeoff  assessments  result 
in  the  construction  of  a sequence  of  hypothetical  alternatives  that  link 
two  real  alternatives,  and  allow  the  inference  of  a preference  (or  rank- 
ing) between  these  two  alternatives.  Systematically,  applying  this  ap- 
proach sequentially  to  all  available  alternatives  results  in  a relative 
ranking  among  them. 


As  tradeoff  assessment  information  is  expressed  and  built  up,  a 
point  can  be  reached  where  remaining  alternatives  may  be  analytically 
ranked  without  further  tradeoff  assessments.  This  last  procedure  is 
considered  optional,  depending  on  the  confidence  attained  by  the  DM  in 
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the  adequacy  of  his  expressed  tradeoff  assessment  information  as  a basis 
for  a valid  analytical  model. 

The  primary  requirement  of  the  method  is  the  identification  of  a 
comprehensive  set  of  MOEs  that  quantify  the  expected  outcomes  of  the 
various  constant-budget  ED  programs.  All  important  MOEs  relating  the 
various  logistics  areas  and  affected  by  the  contemplated  ED  programs  and 
the  mission  of  the  Navy  must  be  included.  However,  to  the  extent  pos- 
sible, the  number  of  MOEs  should  be  minimized  to  include  only  those  that 
measure  distinct  and  separate  types  of  effectiveness.  Required  inputs 
to  the  procedure  then  consist  of  postulated  alternative  ED  programs  and 
the  expected  outcomes  of  the  programs  in  terms  of  the  MOE  levels. 

The  RA  method  procedure  employs  a tableau  where  two  real  alternative 
programs  are  represented  by  their  expected  MOE  values.  These  MOE  values 
are  entered  in  an  order  that  facilitates  use  of  the  tableau  format  and 
application  of  the  procedures.  Tradeoff  assessments  by  the  DM  are  then 
used  to  construct  a set  of  hypothetical  alternatives  in  the  tableau  that 
link  the  two  real  alternatives  in  a manner  that  eventually  allows  the  in- 
ference of  a preference  between  the  two  real  alternatives.  Each  hypo- 
thetical alternative  differs  from  any  preceding  and  successive  alterna- 
tive (whether  real  or  hypothetical)  in  only  two  out  of  a total  of  n MOEs. 
This  allows  the  DM  to  focus  on  his  tradeoff  between  only  two  MOEs  at  a 
time. 

The  key  concept  of  the  method  is  that  the  set  of  hypothetical 
alternatives  serve  as  surrogate  alternatives  for  one  of  the 
real  alternatives  in  the  sense  that  the  DM  is  indifferent  be- 
tween obtaining  the  sets  of  outcome  MOEs  for  the  real  alterna- 
tive and  for  any  one  of  the  hypothetical  alternatives. 

The  RA  method  consists  of  the  following  steps: 

(1)  Select  alternative  pair 

(2)  Reorder  MOEs 

(3)  Construct  tableau 

(4)  Perform  tradeoff  assessment 

(5)  Test  for  dominance 

(6)  Complete  the  tradeoff  assessments  (optional) 


(7)  Perform  linear  optimization  for  next  alternative  selection 

(8)  Test  for  termination  (optional). 

Figure  II-l  presents  a flow  chart  of  these  steps.  In  the  first 
step,  a-priori  subjective  judgment  is  used  to  select  a pair  of  alterna- 
tives for  comparison.  In  Step  2,  the  MOEs  are  then  reordered  in  the 
tableau  to  facilitate  the  remaining  procedures.  This  will  allow,  in 
certain  cases,  the  determination  of  the  preference  between  the  pair  of 
alternatives  without  the  need  to  perform  all  pairwise  MOE  tradeoff  assess- 
ments. The  tableau  is  then  constructed  (Step  3)  and  pairwise  MOE  tradeoff 
assessments  (Step  4)  are  performed  to  construct  the  sequence  of  hypo- 
thetical alternatives.  In  Step  5,  after  some  minimum  number  of  tradeoff 
assessments  have  been  made  (a  number  than  can  be  determined  from  the  MOE 
reordering  process),  a test  can  be  made  to  see  if  one  of  the  real  alterna- 
tives completely  dominates  (in  terms  of  preference)  the  last  hypothetical 
alternative.  If  this  occurs,  it  can  be  inferred  that  this  dominating 
alternative  must  be  preferred  to  the  other  real  alternative.  This  fol- 
lows because  each  hypothetical  alternative  is  constructed  to  be  equal  in 
preference  to  each  other,  and  to  the  first  real  alternative. 

If  such  a dominance  does  not  occur,  the  performance  of  additional 
pairwise  tradeoff  assessments  is  required  in  accordance  with  Step  4, 
but  after  each  new  hypothetical  alternative  is  constructed  a test  for 
dominance  is  conducted  as  per  Step  5.  Eventually  dominance  is  achieved 
or  the  maximum  required  number  of  MOE  tradeoff  assessments  have  been 
completed.  In  the  latter  case,  the  second  real  alternative  can  be 
preferentially  ranked  relative  to  the  last  hypothetical  alternative. 

Since  the  latter  is  a surrogate  for  the  first  real  alternative,  this 
preference  equates  to  the  preference  between  the  two  real  alternatives. 

Once  preference  is  established  between  a pair  of  alternatives,  and 
unranked  alternatives  still  remain,  the  DM  has  an  option  on  how  to  pro- 
ceed. One  approach  is  to  return  to  Step  1,  select  a new  pair  of  alterna- 
tives consisting  of  the  current  most  preferred  alternative  and  an  arbi- 
trary alternative  from  the  remaining  unranked  alternatives,  and  iterate 
through  the  procedures  again.  If  there  are  no  more  unranked  alternatives, 


then  the  procedure  is  terminated  and  the  most  preferred  alternative  has 
been  identified. 

The  other  approach  is  to  proceed  to  Step  6,  where  the  remaining 
tradeoff  assessments,  if  required,  are  completed.  This  provides  sufficient 
information  for  the  construction  of  a linear  model  that  locally  approxi- 
mates the  DM's  tradeoff  structure.  This  model  can  then  be  used  with  an 
optimization  procedure  to  determine  a potentially  most  preferred  alterna- 
tive from  those  remaining  unranked  alternatives  (Step  7). 

Proceeding  to  Step  8,  the  DM  has  two  alternatives  to  assess;  the 
alternative  derived  in  Step  7,  and  the  current  most  preferred  alterna- 
tive. The  linear  model  of  Step  7 will  also  indicate  a potential  prefer- 
ence or  rank  between  these  two  alternatives.  If  the  DM  has  confidence 
in  the  validity  of  the  linear  model  relative  to  these  two  alternatives, 
he  may  accept  the  results  of  the  linear  model,  which  will  also  provide 
the  ranking  of  all  remaining  alternatives.  Step  8 consists  of  the  assess- 
ment of  the  validity  of  the  linear  model.  If  the  validity  is  in  question, 
the  procedure  continues  by  returning  to  Step  2 with  the  two  alternatives 
identified  above.  Otherwise,  the  procedure  is  terminated,  and  the  most 
preferred  alternative  has  been  identified. 

The  procedure  is  primarily  based  on  the  ability  of  the  DM  to  perform 
Step  4,  the  tradeoff  assessment  between  a pair  of  MOE  values  for  two  dif- 
ferent alternatives.  However,  the  only  difference  between  the  two  alter- 
natives is  the  values  of  the  pair  of  MOEs  being  considered.  For  the 
tradeoff  assessment,  the  DM  is  asked  how  much  one  MOE  would  have  to  be 
increased  (or  decreased)  to  compensate  for  a decrease  (or  increase)  of  a 
given  amount  in  the  other  MOE.  This  given  amount  of  decrease  (or  increase) 
is  selected  to  equate  the  value  of  this  MOE  to  its  value  for  the  second 
real  alternative. 

In  addition  to  the  method  development,  a demonstration  problem  was 
constructed.  This  problem  considers  the  Logistic  Supply  System,  one  of 
the  technical  areas  addressed  in  the  Technical  Strategy  for  Logistics  and 
Facilities.  An  examination  of  this  technical  area  resulted  in  the  identi- 
fication of  three  basic  categories  of  MOEs:  expected  response  time, 
costs,  and  manpower.  The  expected  response  time  was  taken  as  the  time 
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from  the  requisition  to  receipt  of  a supply  item  or  material.  Costs  and 
manpower  are  those  increases  or  savings  incurred  in  the  implementation 
of  the  results  of  the  ED  programs.  These  basic  MOE  categories  do  not 
necessarily  represent  a comprehensive  list  of  important  MOE  categories 
for  the  supply  system.  However,  these  were  assumed  to  be  adequate  for 
the  purpose  of  an  initial  effort  on  MOE  selection  and  modeling,  and  a 
demonstration  of  the  application  of  the  method.  In  addition,  it  was 
also  decided,  for  demonstration  purposes,  to  focus  on  response  time  and 
costs  only.  Specific  MOEs  developed  consisted  of  response  times  for 
several  different  supply  scenarios,  and  two  types  of  costs  (or  savings)-- 
capital  investment,  and  operations  and  maintenance.  Navy  (06MN)  costs. 

Each  response  time  for  a given  scenario  constitutes  a separate  MOE  since 
no  objective  and  quantitative  models  for  relating  these  different  response 
times  were  found.  In  addition,  the  two  different  types  of  cost  were  con- 
sidered separately  at  the  request  of  the  sponsor. 

The  following  seven  MOEs  were  identified  and  used  to  demonstrate 
the  RA  method: 

(1)  R ^ = Expected  response  time  in  Scenario  A1 

(2)  R = Expected  response  time  in  Scenario  A2 

(3)  Rg  = Expected  response  time  in  Scenario  B 

(4)  R^  = Expected  response  time  in  Scenario  C 

(5)  Rq  = Expected  response  time  in  Scenario  D 

(6)  Cj  = Annualized  capital  investment  costs 

(7)  = Annual  operating  and  maintenance,  Navy  costs. 

Scenario  A1  applies  to  the  case  of  a small-parts  requisition  by  a 
repair  shop  from  a local  supply  point  (LSP)  or  a nonlocal  supply  point 
(NLSP),  if  the  part  is  not  available  at  the  LSP.  Scenario  A2  is  similar 
in  that  it  applies  again  to  the  case  of  a small-parts  requisition,  but 
onboard  a ship  at  sea.  In  this  case,  the  LSP  is  the  ship's  own  supply 
stocks,  and  the  NLSP  is  another  ship's  supply  stocks.  The  second  ship 
is  assumed  to  be  in  the  same  task  force  as  the  ship  requiring  the  repair 
part.  These  two  scenarios  are  quite  similar  as  their  designation  implies. 
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but  they  were  kept  separate  because  of  the  difference  in  urgency  between 
the  two  cases.  Scenario  B is  a heavy-equipment  requisition  from  an  NLSP 
by  an  aircraft  maintenance  shop  or  a shipyard.  Scenario  C is  a high- 
volume,  normal  supply  requisition  from  an  NLSP.  Finally,  Scenario  D 
covers  the  case  of  underway  replenishment  at  sea. 

A responsiveness  model  was  constructed  to  relate  the  outcomes  of 
various  proposed  ED  projects  to  the  expected  response  time.  This  model 
was  constructed  to  apply  to  all  five  different  scenarios.  Similarly, 
cost  models  were  established  to  relate  the  outcomes  of  various  ED  projects 
to  the  two  types  of  costs. 

To  construct  alternative  programs,  three  budget  levels  were  con- 
sidered. These  were  called  incremental  budget  cases,  and  corresponded 
to  25%,  50%,  and  75%  of  a maximum  add-on  and  new-starts  budget.  At  each 
of  these  incremental  budget  levels,  several  alternate  combinations  of  ED 
projects  were  identified  as  feasible  alternative  programs.  For  each  of 
these  programs  it  was  possible  to  identify  projects,  estimate  outcome 
parameters,  and  employ  these  outcome  parameters  in  the  responsiveness 
and  cost  models  to  determine  MOE  values.  The  set  of  MOE  values  for  each 
alternative  forms  the  input  to  the  RA  method. 

Finally,  numerical  estimates  were  made  for  the  ED  project  outcomes. 
These  estimates  were  not  based  on  any  significant  analysis  of  the  projects, 
but  simply  represent  an  example  of  what  might  occur.  The  RA  method  pro- 
cedures were  then  applied  to  the  example  using  the  author  in  the  role  of 
the  DM.  The  process  was  carried  through  only  for  the  25%  budget  to  the 
point  where  all  procedures  were  illustrated.  A complete  solution  would 
require  additional  iterations,  and  the  consideration  of  the  two  remain- 
ing incremental  budget  cases. 


B.  Cone lusions 

The  RA  method  appears  to  be  a viable  means  of  trading  off  MOEs  and 
ranking  ED  program  alternatives,  if  the  two  following  tasks  are  accom- 
plished to  provide  the  necessary  inputs: 
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(1)  Selection  and  modeling  of  important  MOEs  and  their  re- 
lations to  ED  project  outcomes. 

(2)  Modeling  and  analysis  of  ED  projects  expected  outcomes 
to  obtain  reasonably  high  confidence  in  estimates  of 
their  outcomes. 

The  utility  of  the  RA  method  will  depend  strongly  on  the  DM.  If  he 
finds  that  he  is  able  to  make  the  tradeoff  assessments  required  in  a con- 
sistent and  confident  manner,  the  method  will  provide  him  with: 

(1)  A means  of  simplifying,  organizing,  and  focusing  his 
task  of  judging  the  merits  of  ED  programs  characterized 
by  multiple  and  disparate  MOEs. 

(2)  A preference  ranking  among  various  ED  program  alterna- 
tives. 

(3)  A means  of  tracing  his  rationale  for  ranking  the  alter- 
natives, checking  his  judgmental  consistence,  and  cor- 
recting inconsistencies  as  they  are  found. 

(A)  A means  of  communicating  his  tradeoff  and  preference 

structure  to  his  staff.  This  information  can  be  employed 
to  adjust  or  construct  and  evaluate  new  technology  pro- 
grams. 

The  attack  on  the  problems  of  MOE  selection  and  modeling  has  only 
been  initiated  in  the  effort  reported  herein.  Whether  the  proposed  RA 
method  is  implemented  or  not,  this  is  an  area  that  must  be  better  defined 
and  understood  for  improving  resource  allocation  in  all  logistics  tech- 
nical areas.  For  example,  in  the  supply  area,  the  scenarios  and  respon- 
siveness model  can  undoubtedly  be  improved,  the  manpower  MOE  should  be 
addressed,  and  other  MOEs  such  as  supply  throughput  should  be  included. 

Another  significant  problem  area  is  the  resources  and  techniques 
available  for  analysis  of  ED  project  expected  outcomes.  This  problem 
interfaces  with  the  MOE  selection  and  modeling  problem,  since  only  after 
appropriate  MOE  models  have  been  established  can  the  important  ED  outcome 
parameters  be  identified  and  analysis  techniques  be  developed  to  quantify 
them. 
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Ill  A RESOURCE  ALLOCATION  METHODOLOGY 

Resource  allocation  decisions  must,  in  the  final  analysis,  be  based 
on  an  overall  view  of  the  effects  of  improvements  in  each  of  the  various 
logistics  functional  areas  on  the  ability  of  the  Navy  to  carry  out  its  as- 
signed mission.  There  is  no  one  single  MOE  that  can  measure  that  ability. 
The  best  we  can  do  at  any  given  level  of  decision  making  is  to  identify  a 
number  of  meaningful  and  important  MOEs  that  relate  to  fleet  effectiveness, 
readiness,  and  costs. 

Once  these  MOEs  have  been  identified,  ED  programs  can  be  developed 
that  will  improve  each  of  the  MOEs.  Conversely,  quantitative  estimations 
of  the  improvement  in  each  MOE  expected  as  a result  of  successful  comple- 
tion of  a given  program  can  be  used  to  compare  alternative  programs.  If 
there  were  only  one  MOE,  or  if  through  an  appropriate  model  one  composite 
MOE  could  be  developed  to  measure  the  relative  effects  of  many  MOEs,  al- 
ternative ED  programs  could  be  ranked  in  terms  of  their  expected  output 
of  that  single  MOE.  Assuming  further  that  each  alternative  program  re- 
quired the  same  budget,  the  resource  allocation  problem  would  be  solved 
by  simply  choosing  the  alternative  program  with  the  highest  rank. 

When  two  MQEs  comprise  the  irreducible  set  of  important  MOEs,  the 
ranking  task  becomes  more  complex.  Considering  any  two  equal  budget  al- 
ternatives, we  can  expect  one  of  several  cases  to  occur.  In  the  first 
case,  one  alternative  may  dominate  the  other  in  the  expected  level  of 
both  MOEs.  Clearly,  this  alternative  will  be  preferred  or  ranked  above 
the  other  alternative.  The  second  case  occurs  when  one  alternative 
dominates  another  in  one  MOE,  but  is  equal  in  the  other.  For  ranking 
purposes  this  is  the  same  as  Case  1,  and  we  would  rank  the  first  alter- 
native above  the  other. 

A third  case  occurs  when  both  alternatives  are  equal  in  both  MOEs. 
Clearly  one  alternative  is  as  good  as  the  other.  The  choice  can  then  be 
made  based  on  other  second  order  considerations. 
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The  final  difficult  case  is  where  one  alternative  dominates  another 


n 


i 

! 


I 


in  one  MOE  but  is  dominated  in  the  other  MOE.  It  is  no  longer  clear  which 
alternative  should  be  ranked  higher,  or  whether  they  should  be  equally 
ranked.  Their  ranking  will  now  depend  on  the  relative  importance  of  one 
MOE  versus  the  other.  A tradeoff  assessment  is  required  to  determine  how 
many  units  of  one  MOE  are  equivalent  to  one  unit  of  the  other  MOE. 

Assuming  for  the  moment  that  this  assessment  is  made  for  the  two  al- 
ternatives in  question  and  one  is  ranked  above  the  other,  the  considera- 
tion of  a third  alternative  may  or  may  not  be  simplified.  If  the  relative 
tradeoff  assessment  is  independent  of  the  values  of  each  MOE,  then  the 
same  tradeoff  ratio  can  be  applied  between  the  next  pair  of  alternatives 
to  determine  their  ranking.  On  the  other  hand,  if  this  independence  does 
not  hold,  a new  tradeoff  assessment  must  be  made.  When  more  than  two  MOEs 
comprise  the  irreducible  set  of  important  MOEs,  the  ranking  task  complexity 
increases  rapidly.  Many  more  mixed-dominance  cases  become  possible.  For 
any  two  alternatives,  where  the  dominance  is  mixed  across  the  various  MOEs, 
a tradeoff  assessment  among  several  MOEs  must  be  made.  A DM  must  simulta- 
neously consider  the  relative  importance  of  three  or  more  MOEs.  Even  if 
a EM  finds  that  he  can  make  such  a tradeoff  assessment  among  three  or 
four  MOEs,  he  will  probably  not  be  able  to  judge  his  consistency  between 
his  consideration  of  successive  pairs  of  alternatives,  or  between  his  as- 
sessments at  two  different  times.  At  four  or  more  MOEs  we  can  conclude 
that  even  the  initial  tradeoff  assessment  between  one  pair  of  alternatives 
will  be  an  impossible  task  for  the  vast  majority  of  DMs. 


A.  The  Basic  Concept  of  the  Method 

As  indicated  by  this  brief  discussion,  a DM  faced  with  a resource 
allocation  problem  with  multiple  MOEs  must  make  tradeoff  assessments 
among  the  levels  of  MOEs  achievable  by  the  alternative  programs  being 
considered.  The  cases  we  are  considering  are  when  an  irreducible  set  of 
two  or  more  MOEs  characterize  the  outputs  of  the  alternative  programs. 

By  irreducibility  we  mean  that  we  have  no  objective,  quantifiable  model 
to  relate  any  two  or  more  MOEs  in  such  a manner  that  they  can  be  replaced 
by  a single  derived  MOE.  Each  MOE  is  considered  an  attribute  of  the  ex- 
pected outcome  of  the  alternatives  being  considered.  Thus,  our  decision 
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problem  is  a multi-attribute  problem.  The  terms  attribute  and  MOE  are 
used  synonymously  in  this  report. 

In  attacking  multi-attribute  problems,  it  is  useful  to  distinguish 
between  the  two-attribute  case  and  the  "more-than-two-attribute"  case. 

By  the  irreducibility  assumption,  we  can  do  little  to  assist  the  decision 
maker  in  his  tradeoff  assessment  task  for  the  two-attribute  problem. 

Since  no  objective  model  exists  to  relate  the  two  attributes,  the  trade- 
off assessment  must  be  a subjective  assessment  based  on  the  decision 
makers  experience  and  judgment.  The  DM  must,  in  the  final  analysis,  have 
an  internal  model  of  the  relationship  of  the  two  attributes  to  the  Navy's 
ability  to  carry  out  its  assigned  mission.  The  best  we  can  do  to  assist 
the  DM  in  this  task  is  to  develop  procedures  for  assisting  him  in  orga- 
nizing his  thoughts  on  the  subject,  and  for  improving  his  judgmental  con- 
sistency. 

In  the  more-than-two-attribute  case  we  can  do  significantly  more  to 
assist  the  DM.  The  principal  idea  is  to  attack  the  problem  of  the  need 
to  simultaneously  assess  the  overall  impact  of  three  or  more  attributes 
or  MDEs. 

The  essence  of  the  proposed  method  is  to  decompose  the  multi-attribute 
assessment  problem  into  a sequence  of  simpler  tradeoff  assessment  tasks. 
This  is  accomplished  by  constructing  a sequence  of  hypothetical  outcomes 
(each  consisting  of  a set  of  MOE  values).  These  can  be  viewed  as  repre- 
senting the  outcomes  of  hypothetical  ED  program  alternatives  that  are  as- 
sumed feasible.  Each  hypothetical  outcome  or  program  differs  from  the 
two  sequentially  adjacent  outcomes  in  only  two  MOEs.  They  are  constructed 
in  a manner  that  eventually  links  the  two  real  program  alternatives.  Also, 
the  construction  is  such  that  the  DM  is  indifferent  between  each  hypothet- 
ical outcome,  and  between  any  hypothetical  outcome  and  the  outcome  for  one 
of  the  real  ED  programs. 

The  concept  of  construction  of  the  sequence  of  hypothetical  programs 
is  illustrated  in  Figure  III-l.  In  this  figure  we  show  two  real  programs 
characterized  by  four  MOEs.  These  programs  are  characterized  by  the  values 
of  the  MOEs  designated  a^ , a^,  etc.,  and  b^ , b^,  etc.  Thus  the  two  real 
programs,  called  A and  B,  are  designated  as 
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FIGURE  111-1  HYPOTHETICAL  PROGRAM  CONSTRUCTION 


and 

B = (b^ » , b^ , b^)  . 

Three  hypothetical  programs  are  designated  by  A7,  A77,  and  A 7 7 7,  and  are 
also  shown  in  Figure  III-l.  Note  that  the  two  attributes  in  which  each 
successive  pair  of  programs  differ  are  indicated  within  each  box. 

Comparing  A7  to  A,  we  see  that  A7  has  the  same  MOE  values  except  for 
the  first  pair  of  MOEs.  The  value  of  MOE^  for  A7  is  set  equal  to  the 

value  of  MOE^  for  B,  and  the  value  of  MOE2  is  set  equal  to  c^.  The  pro- 
cedure for  obtaining  c ^ (and  the  other  c^'s)  will  be  described  in  the  fol- 
lowing paragraph.  In  a similar  manner  A77  has  the  same  MOE  values  as  A 7 

except  for  the  pair  of  MOEs  consisting  of  MOE2  and  MOE^.  MOE^  is  set 
equal  to  b^,  the  value  of  MOE^  for  B,  and  the  value  of  MDE^  is  set  equal 
to  c y Through  this  stepwise  procedure  we  progress  from  hypothetical 
alternatives  that  more  closely  match  A to  hypothetical  alternatives  that 
more  closely  match  B. 
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The  hypothetical  programs  in  Figure  III-l  are  obtained  by  the  assign- 
ment of  values  to  c c^,  and  by  the  DM.  He  chooss  these  values  so 
that  he  will  be  indifferent  between  any  adjacent  pair  of  programs.  Thus, 
the  construction  of  the  hypothetical  programs  does  not  entail  lengthy 
analysis  to  establish  the  values  of  the  MOEs  nor  does  it  imply  that  the 
program  is  feasible.  Combinations  of  the  MOE  values  of  the  real  programs 
provide  a basis  for  their  construction,  and  the  choices  of  MOE  values  by 
the  DM  are  made  on  the  basis  of  assumed  feasibility. 

After  the  construction  of  A//7,  we  see  from  Figure  III-l  that  the 
preference  between  A/;/  and  B can  be  determined  solely  on  the  basis  of 
the  values  for  MOE^.  If  b^  is  equal  to  c^,  the  DM  is  indifferent  between 
A7//  and  B;  if  b^  exceeds  c^,  he  prefers  B;  otherwise,  he  prefers  A///. 
Since  he  is  indifferent  between  A and  A//7,  his  preference  between  A and 
B is  established.  In  this  process,  we  see  that  A 7/7  (as  well  as  A4 * *  7 and 
A")  serves  as  a surrogate  for  A. 

The  primary  objective  of  constructing  the  hypothetical  programs  is 
to  relieve  the  DM  of  the  task  of  assessing  simultaneous  tradeoffs  among 
three  or  more  MOEs;  it  offers  him  the  less  con  jx,  though  still  difficult 
task  of  assessing  the  tradeoffs  between  only  two  MOEs.  It  thus  allows 
him  to  focus  his  attention  on  that  part  of  his  internal  model  of  the  im- 
portant overall  effectiveness  relationships  that  relates  to  the  two  MOEs. 

The  output  of  this  approach  provides: 

(1)  A means  of  simplifying  a DM's  subjective  preference  as- 
sessments . 

(2)  A preference  ordering  of  the  alternate  key  area  technology 
programs. 

(3)  Information  on  the  DM's  preferences  that  can  be  employed 
to  adjust  or  construct  and  evaluate  new  preferred  tech- 
nology programs. 

(4)  A means  of  focusing  on  significant  judgmental  assessments 

and  developing  a rationale  for  these  assessments. 

The  remainder  of  this  section  will  briefly  describe  the  method,  its 

mathematical  basis,  and  the  procedures  that  comprise  the  approach.  This 
will  be  done  in  the  context  of  the  decision  problem  with  deterministic 


outcomes.  That  is,  we  assume  that  we  can  estimate  with  high  confidence 
the  effect  of  the  successful  completion  of  a given  ED  program  on  each  MDE. 
The  decision  problem  is  to  select  the  most  preferred  ED  programs  from 
among  competing  programs.  In  Section  V we  shall  then  apply  the  method 
to  a sample  deterministic  output  problem. 

B.  Development  of  the  Methodology 

We  start  by  noting  that  each  alternative  ED  program  can  be  character- 
ized by  its  expected  outcome.  This,  in  turn,  consists  of  the  expected 
achieved  levels  of  each  MOE  or  attribute  relating  to  the  ability  of  the 
Navy  to  carry  out  its  assigned  mission.  Mathematically,  an  outcome  x is 
defined  as  a vector  whose  components  consist  of  the  set  of  relevant  MOEs. 
Thus,  the  outcome  of  each  ED  program  can  be  characterized  by 
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where  x^  is  the  i-th  MOE  variable,  and  there  is  a total  of  n MOEs. 

The  decision  problem  is  to  assess  the  benefit  of  all  possible  sets 
of  outcome  values  that  can  be  achieved  within  a given  budget,  and  select 
the  one  set  of  outcomes  that  maximizes  the  overall  benefit.  The  program 
that  is  expected  to  achieve  these  outcomes  is  then  logically  judged  to  be 
the  most  desirable  or  preferred. 

Implicit  in  this  decision  process  is  the  existence  of  some  model,  at 
least  within  the  decision  maker's  mind,  of  the  relative  contribution  of 
each  MOE  toward  the  net  benefit  to  the  overall  system  objectives.  This 
model  then  allows  the  DM  to  trade  off  amounts  of  one  MOE  against  another 
and  select  one  set  of  expected  outcomes  that  represents  the  best  compro- 
mise among  the  MOEs.  If  this  were  a quantifiable  model,  we  would  state 
that  some  "preference"  or  "utility"  function  f exists  that  assigns  a real 
number  (the  value  of  f)  to  each  outcome  vector  variable  x.  That  is, 

f(x)  - f(xlt  x2,  ... , xn)  . (in-2) 
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This  function  is  such  that  if  one  outcome  vector  x is  preferred  to  another 
outcome  vector  ,y,  then  f(x)  is  greater  than  f(y),  and  if  neither  is  pre- 
ferred over  the  other,  then  f(x)  equals  f(y). 

The  forms  of  the  preference  function  depends  on  the  subjective,  but 
informed,  preferences  of  the  DM.  If  the  form  of  this  function  and  the 
quantitative  assessment  of  its  parameters  could  be  established  for  a given 
DM,  the  decision  process  could  be  conveniently  decomposed  into  two  primary 
functions:  (1)  assessing  and  updating  the  DM's  preference  model,  and  (2) 

formulating  and  selecting  ED  programs  that  maximize  the  DM's  preference 
function.  Under  this  decomposition,  the  DM  need  never  explicitly  make  an 
allocation  decision.  Rather,  he  would  devote  his  efforts  to  quantifying 
and  updating,  as  circumstances  and  preferences  change,  his  preference 
parameters  that  his  staff  uses  to  formulate  and  select  ED  programs.  Thus, 
decision  making  would  be  formalized  and  decentralized,  with  control  still 
remaining  with  the  DM  through  his  preference  information  inputs. 

A significant  problem  in  employing  this  approach  for  ED  resource  al- 
location problems  is  the  feasibility  of  accurately  assessing  the  DM's 
preference  function.  In  the  most  general  case,  where  we  have  little  in- 
formation concerning  the  form  of  the  preference  function,  we  must  ask  the 
DM  to  quantify  his  preferences  among  alternative  outcomes  characterized 
by  more  than  two  attributes.  The  type  of  information  required  could  be 
obtained  by  sequentially  asking  the  DM  to  assign  a number  of  preference 
or  utility  units  characterizing  his  intensity  of  preference  between  sequen- 
tial pairs  of  alternative  outcomes.  A sufficient  number  of  alternative 
outcomes  would  have  to  be  sampled  to  cover  the  range  of  possible  outcomes 
of  interest.  With  a sufficient  sample  of  points,  the  preference  function 
may  be  usefully  approximated  by  this  procedure.  The  feasibility  of  this 
approach  is  questionable  because  a valid  response  to  the  above  question 
may  be  very  difficult  or  impossible  for  the  DM. 

Due  to  this  consideration,  other  approaches  to  preference  assess- 
ments break  the  task  into  a number  of  smaller  tasks,  and  employ  some  as- 
sumption regarding  the  functional  form  of  the  preference  function.  One 
particularly  convenient  form  is  the  separable  form  given  by 


f(x)  = f[f1(x1),  f2(x2) 


(III-3) 


f OO) 

n n 

where  each  of  the  f^'s  is  a function  of  only  one  variable  x^. 

The  validity  of  using  the  separable  form  can  be  checked  by  verifying 
sets  of  assumptions  about  the  DM's  preferences.  Two  basic  assumptions  are 
referred  to  as  preferential  independence  and  utility  independence.*  A 
pair  of  attributes  (x^ , x^)  is  preferentially  independent  of  the  attri- 
butes (x^,  . ..,  xn)  if  preferences  among  (x^,  pairs,  given  that 

(x~,  ...,  x ) are  held  fixed,  do  not  depend  on  the  level  where  (x_,  ...,  x ) 
on  on 

are  fixed.  Preferential  independence  implies  that  the  tradeoffs  between 

attributes  x^  and  x^  do  not  depend  on  x^ xr.  The  attribute  x^  is 

utility-independent  of  the  other  attributes  (X2»  ...,  xn)  if  preferences 
among  lotteriest  over  x^  specifying  various  amounts  of  x^  and  probabili- 
ties of  receiving  them,  given  that  x^»  ...»  are  fixed,  do  not  depend 
on  the  levels  where  they  are  fixed. 

When  the  above  form  is  valid,  the  preference  assessment  task  requires 
determining  the  f^  functions  corresponding  to  each  attribute.  Procedures 
for  determining  the  f^'s  have  been  developed*  employing  tradeoff  assess- 
ments between  pairs  of  attribute  levels. 

Assessment  of  preferences  using  the  above  model  and  approach  is  dif- 
ficult but  feasible  in  some  situations.  It  is  likely  that  several  itera- 
tions of  such  assessments  will  be  required  before  the  DM  is  comfortable 
with  the  results.  The  advantage  of  this  approach  is  that  the  tasks  have 
been  broken  down  to  the  point  that  the  DM  focuses  on  one  attribute  at  a 
time  to  assess  the  form  of  the  f^'s,  and  on  pairs  of  attributes  to  ap- 
propriately scale  the  relative  magnitudes  of  these  functions.  A serious 


* 

D.  V.  Winterfeldt  et  al. , "Multi-Attribute  Utility  Theory:  Models  and 
Assessment  Procedures,"  AD-770  576,  Technical  Report,  Contract  N00014- 
67-A-0181-0049 , University  of  Michigan,  Ann  Arbor,  MI  (5  November  1973). 

^A  lottery  over  x^  is  a chance  to  increase  x^  by  a given  amount  with  prob- 
ability p,  versus  a chance  to  decrease  x^  by  some  other  amount  with  prob- 
ability 1 - p. 

*P.  C.  Fishburn,  "Methods  for  Estimating  Additive  Utilities,"  Management 
Science.  Vol.  13,  pp.  435-453  (1967). 
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weakness  in  the  above  model  is  that  it  is  based  on  the  assumptions  of 
preferential  and  utility  independence.  When  these  assumptions  do  not 
hold,*  the  procedure  is  no  longer  valid. 

The  approach  advocated  in  this  report  does  not  require  these  restric- 
tive independence  assumptions.  However,  when  this  independence  does  hold, 
the  approach  can  exploit  this  fact.  The  approach  requires  only  tradeoff 
assessments  between  pairs  of  attributes.  These  assessments  are  made  at 
points  in  the  outcome  space  related  to  and  including  the  feasible  alter- 
natives being  evaluated.  Thus,  there  is  a closer  coupling  between  the 
DM's  preference  considerations  and  the  set  of  feasible  outcomes  achiev- 
able from  the  set  of  alternative  ED  programs. 

The  proposed  approach  starts  with  a set  of  alternative  ED  programs, 
and  the  corresponding  achievable  outcomes.  These  are  used  to  establish 
points  in  the  outcome  space  at  which  preference  assessments  are  made. 

For  each  pair  of  achievable  outcomes  (characterized  by  n attributes, 
which  may  all  differ  from  each  other  in  achievable  level) , a sequence  of 
hypothetical  outcomes  are  generated  that  link  the  pair  of  outcomes  in  the 
following  manner.  Each  hypothetical  outcome  differs  from  the  previous 
hypothetical  outcome  in  the  level  of  only  two  out  of  n attributes.  The 
first  hypothetical  outcome  differs  in  this  manner  from  the  first  real 
outcome,  and  the  last  hypothetical  outcome  differs  similarly  from  the 
second  real  outcome.  Thus,  if  there  are  n attributes,  n - 1 hypothetical 
outcomes  are  required  to  link  any  two  real  outcomes.  Preference  assess- 
ments are  then  made  by  the  DM  at  each  of  these  outcome  points. 

It  is  important  to  observe  that  although  we  have  apparently  expanded 
our  problem  of  comparing  two  n-dimensional  real  outcomes  to  comparing  n 
n-dimensional  outcomes,  in  reality  we  have  effectively  decomposed  the 
comparison  to  comparing  n 2-dimensional  outcomes.  This  is  a consequence 
of  the  fact  that  each  outcome  in  the  sequence  differs  from  the  previous 
in  only  two  attributes.  Since  all  other  attributes  have  identical  levels, 
quantifying  tradeoff  assessments  between  outcomes  only  involves  thinking 
about  two  attributes  at  a time,  a 2-dimensional  problem. 

* 

A linear  preference  function  is  one  case  where  these  independence  assump- 
tions do  hold. 
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The  last  statement  above  is  not  completely  accurate  since  the  levels 
of  the  remaining  n-2  attributes  cannot  be  simply  discarded  and  not  con- 
sidered in  the  tradeoff  assessment.  The  DM  must  firmly  establish  in  his 
mind  what  the  levels  of  the  n-2  attributes  are  and  their  implications  for 
the  tradeoffs  of  the  remaining  2 attributes.  He  is  really  making  a con- 
ditional tradeoff  assessment,  conditioned  on  the  levels  of  the  remaining 
attributes.  If  it  turns  out  that  the  levels  of  the  remaining  attributes 
do  not  affect  his  tradeoff  assessment,  then  the  preferential  independence 
assumption  stated  above  is  satisfied  and  this  fact  can  be  exploited  to 
reduce  subsequent  tradeoff  assessments  between  other  outcome  pairs. 

After  tradeoff  evaluations  between  a pair  of  outcomes  is  accomplished, 
a second  pair  of  outcomes  consisting  of  the  preferred  outcome  from  the 
previous  set  and  one  of  the  remaining  outcomes  from  the  feasible  set  are 
then  selected.  The  procedure  used  to  compare  the  previous  set  of  outcomes 
can  then  be  repeated  to  establish  the  next  preferred  outcome.  After  all 
outcomes  have  been  evaluated  in  this  manner,  we  are  left  with  the  most 
preferred  outcome.  The  ED  program  that  achieves  the  most  preferred  out- 
come is  the  most  preferred  program. 

This  approach  will  be  illustrated  with  an  example.  Initially  we 
will  consider  a very  simple  example  and  develop  the  necessary  procedures 
to  implement  the  approach,  from  which  certain  implications  can  be  drawn 
that  lead  to  more  efficient  procedures. 

Consider  simple  situation  in  which  there  are  three  important  MQEs 
that  measure  the  benefits  of  any  ED  program.  Further  assume  that  these 
MOEs  are  quantifiable  and  vary  depending  on  the  manner  in  which  funds  are 
expended  on  exploratory  development.  Each  alternative  way  of  spending  a 
fixed  budget  is  a unique  ED  program.  The  outcome  of  each  ED  program  can 
be  specified  in  terms  of  the  MOEs  or  attributes.  If  there  are  two  alter- 
native programs  A and  B,  and  the  relevant  outcome  attributes  are  designated 
x^,  and  x^,  respectively,  we  can  say  that  program  A will  result  in 
x^  = a^,  x^  = a2,  and  x^  = a^ , and  program  B will  result  in  x^  = b^, 
x2  = b^,  and  x^  = b^.  We  associate  these  outcomes  with  programs  A and 
B,  respectively,  and  designate  the  two  outcomes: 


A = (aj,  a2,  a3)  (III-4) 

and 

B - (b^ , b2,  b3)  . (III-5) 

We  also  assume  that  the  x^'s  are  defined  so  that,  all  else  being 
equal,  a higher  level  of  x^  is  preferred  to  a lower  level.  This  is  not 
restrictive  because  we  can  always  transform  the  MOE  so  that  this  will  be 
true.  Thus,  if  b^  was  greater  than  a^  for  i = 1,  2,  and  3,  then  we  would 
prefer  B to  A and  would  fund  program  B.  On  the  other  hand,  if  b2  and  b3 
were  greater  than  a2  and  a3,  respectively,  while  a^  was  greater  than  b^, 
it  would  not  be  clear  which  was  more  preferred.  It  would  depend  not  only 
on  how  much  a^  was  greater  than  b^  and  how  much  b2  and  b3  were  greater 
than  a2  and  a3,  but  also  on  the  relative  importance  of  the  attribute  x^ 
compared  to  x2  and  x3< 

In  comparing  these  two  outcomes,  the  difficulty  is  in  simultaneously 
trading  off  three  different  attributes.  The  problem  is,  of  course,  more 
severe  if  there  are  more  than  three  attributes.  To  decompose  this  prob- 
lem so  that  a tradeoff  between  only  two  attributes  is  necessary,  consider 
a third  hypothetical  outcome--call  it  A7.  Let  A7  have  the  following 
values : 


A7  = c2,  a3)  (III-6) 

where  c ^ is  to  be  determine. 

At  this  point  we  introduce  a tableau  in  Figure  III-2  that  will  help 
in  visualizing  the  following  discussion,  and  will  form  the  primary  tool 
in  the  proposed  procedure.  In  Figure  III-2  each  row  corresponds  to  an 
alternative  (real  or  hypothetical)  and  each  column  corresponds  to  an  MOE. 
The  vertical  dashed  line  separates  those  MOEs  for  which  A dominates  B 
from  those  for  B dominates  A.  The  box  indicate  the  responses  required 
from  the  DM. 
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A > B 


A < B 


X2  X3 


f 2 a3 


Alternative 

Programs 

(Real)  A 


(Hypothetical)  A 7 1 C2  a3 


(Real)  B 


FIGURE  II 1-2  TRADEOFF  ASSESSMENT  TABLEAU 

To  determine  we  ask  the  DM  to  consider  outcomes  A7  and  A,  and  to 
firmly  establish  in  his  mind  the  values  of  a^,  a^,  and  a^ , and  the  sig- 
nificance of  the  corresponding  attributes  x^,  x^,  and  x^.  We  then  ask 
him  to  fix  a^  in  his  mind  and  consider  variations  in  the  levels  of  x^ 
and  from  the  values  a^  and  a In  particular,  if  x^  were  decreased 

from  a^  to  b^,  and  x ^ could  increased  from  a^  to  compensate,  how  much 
would  x^  have  to  be  increased  to  make  the  DM  indifferent  to  achieving 
outcome  (a^,  a^,  a^)  or  outcome  (b^,  a^  + A,  a^)  where  A is  the  amount 
of  his  response?  The  value  of  c^  is  then  set  equal  to  a^  + A,  and  we 
conclude  that  he  is  indifferent  to  obtaining  outcome  A or  A7.  We  can 
write 


A = (a.,  a , a.)  ~ (b.  , c , a,)  = A' 


(III-7) 


where  the  symbol  ~ means  indifference  (the  symbols  > and  < will  be  used 
to  indicate  "preferred  to,"  and  "less  preferred  than,"  respectively). 

In  Figure  III-2,  the  pair  of  arrows  with  the  + or  - sign  indicate 
the  pair  being  traded  off,  and  the  sign  of  the  changes  required. 

We  can  now  compare  b^  to  c If  b ^ is  greater  than  or  equal  to  c^, 
and  remembering  that  b^  is  greater  than  a^,  we  can  infer  that  B is  pre- 
ferred to  A7,  which  is  equivalent  to  A.  That  is,  B >A7~A.  This  im- 
plies that  B is  preferred  to  A and  we  have  accomplished  our  objective  of 
ranking  A and  B.  On  the  other  hand,  if  b^  is  less  than  we  do  not  know 
yet  whether  A is  preferred  to  B or  vice  versa. 
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In  the  latter  circumstance,  we  consider  a new  hypothetical  outcome 
A77  having  the  following  values: 

A77  = (bl»  b2*  C3)  (HI-8) 

where  c^  is  to  be  determined.  Figure  III-3  shows  an  expansion  of  the 
tableau  from  Figure  III-2  to  include  A77.  To  determine  c^  we  ask  the  DM 
to  consider  outcomes  A7  and  A77,  and  to  consider  variations  in  the  levels 
of  and  x^  from  values  c^  and  a^.  We  ask,  if  x^  were  decreased  from  c^ 
to  b^,  how  much  would  a^  have  to  be  increased  to  make  him  indifferent  to 
(bi»  c , a^)  or  (b^,  b^,  a^  + A)?  Again  c^  is  set  equal  to  a^  + A and  we 
can  write 

A ~ A7  = (bv  c2,  a3)  ~ (bL,  b2,  c3)  = A"  . (III-9) 


We  now  compare  b^  to  c^.  If  b^  is  greater  than  c^ , the  DM  prefers 
B to  A".  If  b^  equals  c^,  then  he  is  indifferent  between  B and  A7'. 
Finally,  if  b^  is  less  than  c^,  he  prefers  A77  to  B.  In  each  of  the  three 
eventualities,  A77  (as  well  as  A7)  is  a surrogate  for  A since  A ~ A 7 ~ A 7 


I 
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Thus,  whatever  the  preference  relation  between  B and  A77,  the  same  pref- 
erence holds  between  B and  A, 

Now  consider  a brief  numerical  example.  Let 

A = (10,  5,  7)  (III-10) 

and 

B = (7,  7,  9)  . (III-ll) 


We  construct  the  tableau  shown  in  Figure  III-4.  The  question  is  how  much 
must  x^  be  increased  to  compensate  for  a 3-unit  decrease  in  x,  from  10  to 
7 with  all  other  MQEs  equal?  If  the  response  is  to  increase  x^  from  5 to 
6 we  update  the  tableau  to  Figure  III-5.  Comparing  B to  A7  in  each  MOE, 
we  see  that  B is  not  dominated  by  A 7 in  any  MOE,  and  that  it  dominates  A7 
in  at  least  one  MOE  (two  in  this  case,  and  x^) . Thus,  B > A7  ~ A or 
B > A. 


Now  assume  instead  that  the  response  was  to  increase  x^  from  5 to  8. 
This  result  is  shown  in  Figure  III-6.  Since  A7  dominates  B in  and  is 
dominated  by  B in  x^,  we  cannot  yet  rank  A and  B.  A second  tradeoff 


t 

**  • 


assessment  is  required  and  the  question  is  how  much  must  x^  be  increased 
to  compensate  for  a decrease  of  from  8 to  7 with  all  other  MOEs  equal? 
If  the  response  is  to  increase  x^  from  7 to  8,  we  conclude  that  B > A77 
~ A7  ~ A,  or  B > A.  On  the  other  hand,  if  x^  were  increased  to  10,  the 
opposite  would  be  true  and  A > B. 


Alternative- 

Programs 


(Real)  A 


(Hypothetical)  A7 


(Hypothetical)  A' 


(Real)  B 


FIGURE  111-5  TABLEAU  UPDATE— CASE  1 


Alternative' 

Programs 


(Real)  A 


(Hypothetical)  A7 


(Hypothetical)  A' 


(Real)  B 


FIGURE  111-6  TABLEAU  UPDATE— CASE  2 
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We  can  now  readily  see  how  to  generalize  this  procedure  to  the  case 
of  n MOEs.  We  first  select  two  alternatives,  A and  B,  and  inspect  the 
successive  pairs  of  values  for  each  MQE.  We  find  that  in  m cases  A > B, 


in  p cases  A ~ B,  and  in  q cases  A < B,  where  m + p + q = n.  We  select 
the  minimum  of  m and  q (assume  it  is  m)  and  rearrange  the  MOEs  so  that 
the  first  m consist  of  the  case  where  A > B,  the  next  q consist  of  the 


case  where  A < B,  and  the  remaining  p consist  of  the  case  where  A ~ B. 

I For  specificity  assume  that  n = 6,  m = 2,  q = 3,  and  p 1.  We  can  now 

construct  the  tableau  shown  in  Figure  III-7. 

Figure  III-7  shows  several  interesting  properties  of  this  procedure. 


First,  the  maximum  number  of  hypothetical  alternatives,  and  thus  the 


maximum  number  of  tradeoff  assessments,  is  m + q - 1 or,  in  this  case, 

2 + 3 - 1 = 4.  The  minimum  number  of  tradeoff  assessments  required  is 
max(l,  m - 1) , or  in  this  case,  max(l,  2 - 1)  = i.  (Note  that  at  least 
one  tradeoff  assessment  will  always  be  required.)  This  minimum  number 
of  tradeoff  assessments  would  occur  if  c^  were  less  than  or  equal  to  b^ 
(or  in  general  if  c were  less  than  or  equal  to  b ) . In  such  a case.  B 
would  dominate  the  (m  - l)-th  hypothetical  alternative  in  at  least  q - 3 
MOEs  and  not  be  dominated  by  the  (m  - l)-th  hypothetical  alternative  in 
any  MOE.  Thus,  B would  be  preferred  to  A. 


If,  in  fact,  B > A we  discover  that  fact  anywhere  from  the  (m  - l)-th 
tradeoff  assessment  to  the  (m  + q - l)-th  tradeoff  assessment.  If,  on  the 
other  hand,  A > B or  A ~ B we  would  discover  that  fact  only  after  the 
(m  + q - l)-th  tradeoff  assessment. 

In  Figure  III-7  we  can  also  note  the  relationship  between  any  hypo- 
thetical alternative  and  each  of  the  pair  of  real  alternatives.  We  see 
that  the  first  k MOEs  of  the  k-th  hypothetical  alternative  are  equal  in 
value  to  the  MOEs  of  alternative  B,  and  the  last  n-k-1  MOEs  are  equal  to 
the  MOEs  of  alternative  A.  Thus,  the  hypothetical  alternatives  can 
readily  be  constructed  from  alternatives  A and  B.  The  remaining  MOE 
value  to  complete  each  hypothetical  alternative  is  supplied  by  the  trade- 
off assessment  of  the  DM.  He  accomplishes  this  without  any  thought  as  to 
whether  or  not  the  hypothetical  alternative  is  feasible  or  what  the  real 
cost  may  be.  This  is  true  since  even  if  the  alternative  were  feasible, 
he  need  never  seriously  consider  implementing  it.  If  it  costs  more  than 
or  equal  to  the  budget,  he  will  select  either  A or  B,  since  A is  as  good 
and  B may  be  better  and  neither  costs  more.  If  it  costs  less  than  the 
budget,  he  should  advise  his  staff  to  find  an  improve  alternative  whose 
cost  equals  the  budget,  and  he  will  select  either  the  new  alternative 
or  B. 
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At  this  point  in  the  development  we  present  a mathematical  and 
graphical  model  of  the  tradeoff  assessment  process  outlined  above,  and 
use  it  to  derive  one  additional  useful  concept. 

In  our  three  MOE  examples  let  the  preference  function  be  represented 
by 
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f(x)  = fCXj,  x2,  x3) 


(III-12) 


A 4-dimensional  graph  is  needed  to  plot  any  specific  form  of  Eq,  (III-12). 
However,  we  can  ease  that  task  by  fixing  one  of  the  values  of  x^  and  plot- 
ting contours  of  the  function  in  two  dimensions.  Thus,  let  x^  be  equal 
to  7,  the  value  of  a^  in  the  previous  numerical  example.  We  can  now  plot 
the  locus  of  all  combinations  of  x^  and  x^  that  correspond  to  a fixed 
value  of  f(x)  when  x^  is  held  at  7.  Figure  III-8  shows  several  of  these 
loci  for  various  values  of  f(x).  These  contours  are  iso-preference  curves 


FIGURE  111-8  ISO-PREFERENCE  CONTOUR  GRAPH 


so  that  the  DM  is  indifferent  between  any  two  points  on  the  same  curve. 

In  selecting  the  shape  of  these  contours  we  have  assumed  that  as  one  MOE 
gets  smaller,  an  increasing  amount  of  change  is  required  to  compensate. 
This  i<-  not  a vital  assumption,  but  would  apply  for  many  types  of  MOEs. 

We  can  view  these  iso-preference  contours  as  contours  of  a hill  ris- 
ing out  of  the  plane  of  the  paper.  Higher  values  of  f(x)  correspond  to 
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higher  altitude  on  the  hill,  and  we  prefer  to  allocate  our  budget  on  a 
program  with  outcome  x that  has  the  largest  value  of  f(x).  Thus,  we  wish 
to  climb  the  hill,  but  our  budget  constrains  how  high  we  can  climb  as  a 
function  of  the  direction  we  climb.  Figure  III-9  shows  a budget  constraint 
curve  superimposed  on  the  iso-preference  curves.  Also  shown  in  Figure 
III-9  are  the  points  A and  k'  from  the  previous  numerical  example,  and 


FIGURE  111-9  ISO-PREFERENCE  CONTOUR  GRAPH  WITH  BUDGET  CONSTRAINT 


another  point  C that  is  a feasible  outcome  and  alternative  within  the  same 
budget  as  A.  k'  is  the  hypothetical  alternative  constructed  so  that  it 
lies  on  the  same  iso-preference  curve,  but  as  shown  is  not  feasible  within 
the  budget  constraint.  Point  C has  more  of  MOE  x^  but  less  of  MOE  x^  com- 
pared to  point  A.  Since  C and  A/  differ  in  only  one  MOE,  and  since  A/ 
dominates  C in  that  MOE,  we  conclude  that  A ~ A/  > C. 

Returning  to  the  hill-climbing  analogy,  the  budget  constraint  curve 
is  like  a fence  constructed  on  the  hill.  Our  objective  is  to  climb  as 
high  as  possible  without  crossing  the  fence.  As  shown,  point  A is  the 
highest  we  can  get  and  represents  a preferred  alternative  to  point  C. 
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In  assessing  the  DM's  tradeoffs  between  x^  and  we  have  effectively 
obtained  the  slope  of  the  line  through  points  A and  k'  (the  full  forms  of 
the  iso-preference  curves  are  unknown  to  us).  The  slope  represents  a local 
approximation  to  the  iso-preference  curve  through  A and  A/,  at  least  in 
the  region  of  A,  A/,  and  C.  We  can  then  conclude  that  we  are  likely  to 
find  preferred  points  above  this  tradeoff  line  and  less  preferred  points 
below.  As  we  see  in  Figure  III-9,  this  relationship  is  true  between  points 
A and  C. 

Of  course  we  have  not  brought  alternative  B into  the  picture  as  yet, 
because  f-  1 for  B.  To  bring  in  B we  must  employ  a 3-dimensional  per- 
spective plot.  In  this  plot,  the  budget  constraint  curve  will  be  a curved 
surface  roughly  like  an  ellipsoid,  and  the  iso-preference  contours  will  be 
like  the  layers  of  an  onion,  some  of  which  intersect  the  budget  constraint 
surface. 

Figure  III-10  is  an  attempt  to  depict  this  geometry.  In  Figure  III-10, 
the  long-dashed  curves  represent  the  intersections  of  the  budget  con- 
strained surface  with  the  (x^,  y^) , (x£,  x^) , and  (x^,  x^)  planes.  In  ad- 
dition, we  show  two  slices  of  this  surface,  where  curves  and  P^P^ 

indicates  the  intersection  of  the  surface  with  planes  parallel  to  the 

(Xj , x^)  plane  and  (x^ , x^)  plane,  respectively.  These  slices  were  se- 
lected to  pass  through  points  (or  alternatives)  A and  B,  respectively. 

The  budget  constrained  surface  is  convex  to  the  viewer. 

Of  course  there  are  an  infinite  number  of  iso-preference  surfaces  in 
this  3-dimensional  space.  These  surfaces  are  all  concave  to  the  viewer. 
Figure  III-10  shows  a portion  of  the  surface  passing  through  point  A. 

This  portion  is  defined  by  curves  AA7..  A'a",  and  k''k.  Note  that  curve 
AA  ' is  in  the  plane  of  the  slice  through  point  A,  and  curve  k'k''  is  in 

the  plane  of  the  slice  through  point  B.  Curve  A * 'k  is  in  a plane  parallel 

to  the  x^  axis.  Also  note  that  the  iso-preference  surface  depicted  inter- 
sects the  budget  constrained  surface  at  point  A,  and  at  the  two  points 
where  curves  AA  and  k''k  transition  to  dashed  lines.  Point  B meanwhile 
is  below  the  iso-preference  surface,  implying  that  A > B.  The  purpose  of 
the  method  is  to  determine  this  fact  without  full  knowledge  of  the  shape 
and  location  of  the  iso-pref erence  surface. 
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In  the  previous  example  we  accomplish  this  by  determining  the  loca- 
tions of  points  A and  k' ' from  the  DM's  tradeoff  assessments.  In  this 
particular  case  we  assume  that  the  DM's  responses  are  such  that  k' ' domi- 
nates B in  the  x^  MOE  while  it  equals  B in  the  other  MOEs.  Thus,  what- 
ever the  shape  of  the  iso-preference  surface,  B must  lie  below  that 
surface,  and  A,  which  is  on  the  surface,  must  be  preferred  to  B. 

Just  as  in  the  two-dimensional  case  where  we  concluded  that  points 
A and  k'  defined  a line  approximating  the  two-dimensional  iso-preference 
curve,  we  can  see  that  points  A,  k\  and  k'  ’ define  a plan  that  locally 
approximates  the  iso-preference  surface  in  the  three-dimensional  case. 

Me  also  note  that  point  B is  below  this  plane.  Furthermore,  we  can  extra- 
polate to  the  n-dimensional  case  and  conclude  that  the  hypothetical  alter- 
natives define  an  (n  - 1) -dimensional  hyperplane  approximating  the 
iso-preference  hypersurface. 

Returning  to  the  3-dimensional  case,  we  can  note  that  there  are 
regions  of  the  budget  constrained  surfaced  that  lie  above  the  iso-preference 
surface  shown  in  Figure  III-10.  The  alternative  programs  represented  by 
points  in  this  region  are  preferred  to  A.  In  the  case  illustrated  we  have 
assumed  that  the  outcome  MOEs  of  each  feasible  and  budget  constrained 
alternative  are  continuously  variable.  Thus,  there  will  be  a most  pre- 
ferred alternative  other  than  A.  In  practice  the  MOEs  may  not  vary  con- 
tinuously and  the  budget  constrained  surface  may  reduce  to  a finite  number 
of  separate  points,  one  of  which  may  or  may  not  lie  above  the  iso-preference 
curve  through  A. 

Since  we  do  not  know  the  shape  of  the  iso-preference  curve  we  can 
only  consider  what  information  we  do  have  about  the  iso-preference  curve. 
This  information  consists  of  the  fact  that  A,  k',  and  k''  all  lie  on  the 
same  preference  surface,  and  they  define  a plane  that  is  a local  approxi- 
mation to  that  surface.  Points  on  the  budget  constrained  surface  may  or 
may  not  lie  above  this  plane.  However,  if  a budget  constrained  point  does 
lie  above  this  plane,  it  will  likely  also  lie  above  the  iso-preference 
surface.  Based  on  this  state  of  information  we  can  conclude  that  the 
budget  constrained  point  or  alternative  that  is  furthest  above  the  plane 
will  likely  be  the  most  preferred.  We  can  readily  find  that  point — say 
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it  is  C — and  determine  the  relative  ranging  of  A and  C through  the  appli- 
cation of  the  tradeoff  method. 


In  case  there  is  no  budget-constrained  point  above  the  tradeoff  plane, 
we  can  find  the  point  below  the  plane  that  is  closest  to  the  plane.  This 
point  represents  the  most  likely  point,  from  among  those  remaining,  that 
may  be  preferred  to  A. 


Unfortunately,  whichever  is  preferred,  the  hyperplane  concept  does 
not  necessarily  select  the  most  preferred  from  the  set  of  candidates. 

This  is  because,  without  restrictive  conditions  on  the  shape  of  the  iso- 
preference surface,  C was  chosen  based  only  on  the  approximation  repre- 
sented by  the  plane  through  A,  A7,  and  A7/,  Thus,  we  must  still  apply 
the  tradeoff  methodology  to  points  A and  C to  determine  conclusively  which 
is  preferred. 


The  procedure  for  selecting  C will  at  the  minimum  lead  to  maximizing 
the  probability  that  we  will  have  considered  and  ranked  the  most  preferred 
alternative  early  on.  At  the  maximum,  the  tradeoff  assessment  process  and 
data  could  sharpen  the  DM's  judgmental  perspective  to  the  point  where  he 
can  assess  the  adequacy  of  the  representation  of  his  preference  tradeoffs 
by  the  information  encoded  in  the  most  recent  hyperplane.  This  informa- 
tion represents  a linear  model  of  the  DM  preference  tradeoffs.  If  this 
linear  model  is  considered  a valid  representation  of  his  preference  trade- 
offs over  the  region  of  the  remaining  alternatives,  it  can  be  used  to 
rank  these  remaining  alternatives  without  further  tradeoff  assessments. 

No  decision  rules  have  been  found  to  ensure  that  this  last  procedure  would 
obtain  the  most  preferred  alternative.  Thus,  it  can  only  be  included  as 
an  optional  procedure  based  on  the  DM's  subjective  judgment. 


The  procedure  for  selecting  successive  alternatives  for  the  tradeoff 
method  consists  of  finding  the  feasible  budget  constrained  point  from 
among  those  not  previously  ranked  that  maximizes  the  linear  function, 

n 


8(X)  = £ \i  Xi  • 


1 


I j 


l 

a 1 


(III-13) 


d 


This  function,  g(x)  , measures  the  "distance"  of  any  vector  (x,  , x„ , ...,x  ) 
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above  the  tradeoff  hyperplane  characterized  by  the  vector  (Yn£>  Yn2! 
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The  x.'s  are  the  MOE  values  for  each  feasible  alternative,  and  the  Y ,'s 
i m 


are  the  set  of  slopes  defining  the  hyperplane.  For  i = 1 to  n,  each  Y 


is  the  slope  of  the  hyperplane  in  the  (x^ , x^)-th  plane.  This  implies 


that  Y =1.  The  Y 's  are  obtained  from  the  DM's  response  data  after 
nn  ni 

each  application  of  the  tradeoff  assessment  procedure.  The  derivation  of 


Eq.  (III-13)  and  the  definition  of  the  Y ^'s  are  developed  in  Appendix  A. 


C.  The  Procedures  of  the  Method 


The  procedures  described  in  this  section  comprise  a tradeoff  method 
for  multi-attribute  decision  problems.  The  method  is  applied  after  ap- 
propriate MOEs  have  been  derived  and  budget  constrained  feasible  ED  alter- 
natives have  been  constructed  and  described  in  terms  of  the  MOEs.  It  is 
also  assumed  that  there  is  no  alternative  that  dominates  all  other  alter- 
natives in  each  MOE,  and  that  all  alternatives  that  are  dominated  in  each 
MOE  by  all  other  alternatives  have  been  discarded.  In  the  former  case, 
there  is  no  need  for  the  method  and  the  dominant  ED  alternative  should  be 
funded. 


In  the  procedures  below,  the  word  "dominated"  is  used  in  the  prefer- 
ential sense  rather  than  the  quantitative  sense.  Thus,  if  a smaller  value 
of  a particular  MOE  is  preferred  to  a larger  value,  smaller  numerical  MOE 
values  will  dominate  larger  numerical  MOE  values. 


The  tradeoff  assessment  method  consists  of  the  following  steps: 
(1) 


Select  alternative  pair.  Initially,  select  the  two  poten- 
tially most  preferred  alternatives  based  on  the  a-priori 
subjective  assessment  of  the  DM.  On  subsequent  iterations 
through  Step  1,  select  the  current  highest-ranking  alter- 
native and  one  other  potentially  most  preferred  alternative 
from  among  the  remaining  alternatives. 


(2)  Reorder  MOEs.  Reorder  the  MOEs  so  that  the  minimum  number 


of  dominated  MOEs  between  the  two  alternatives  are  at  the 
beginning  of  the  sequence  of  MOEs,  and  the  remaining 
reverse-dominated  MOEs  are  listed  next  followed  by  the  re- 
maining equal-value  MOEs  (if  any). 
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(3)  Construct  tableau.  Construct  the  tradeoff  assessment 
methodology  tableau  so  that  the  top  alternative  domi- 
nates the  bottom  alternative  in  the  first  MOE. 


(4)  Perform  tradeoff  assessment.  Obtain  the  DM's  response 
between  the  appropriate  pair  of  MOEs  within  the  tableau. 
Each  response  completes  the  construction  of  a hypothet- 
ical alternative. 

(5)  Test  for  dominance.  After  the  minimum  number  of  trade- 
off assessments  (m  - 1)  have  been  completed,  determine 
whether  the  bottom  alternative  completely  dominates  the 
last  hypothetical  alternative.  If  it  does,  the  bottom 
alternative  is  ranked  as  more  preferred  than  the  top  al- 
ternative. If  unranked  alternatives  remain,  we  proceed 
to  Step  1 or  Step  6 at  the  option  of  the  DM.  Otherwise, 
we  have  completed  the  procedure  and  the  most  preferred 
alternative  has  been  identified.  If,  on  the  other  hand, 
dominance  has  not  yet  occurred,  further  tradeoff  assess- 
ments are  required  and  we  return  to  Step  4.  After  the 
maximum  number  of  tradeoff  assessments  (m  + q - 1)  have 
been  completed,  the  two  alternatives  are  ranked  by  com- 
paring the  last  MOE  involved  in  the  tradeoff  assessment. 
Again,  we  proceed  to  Step  1 or  Step  6 if  unranked  alter- 
natives remain. 
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(6)  Complete  the  tradeoff  assessments  (optional).  If  a com- 
plete set  of  tradeoff  ratios  have  not  been  established, 
the  Yni's  in  Eq.  (III-13)  are  not  all  known,  and  the 
linear  function  cannot  be  optimized  to  determine  the 
next  alternative.  However,  at  the  option  of  the  DM,  the 
remaining  tradeoff  assessments  (obtained  according  to 
Step  4)  can  be  accomplished.  The  Yn£'s,  which  are  trade- 
off ratios  between  the  n-th  or  last  MOE  and  the  i-th  MOE 
can  then  be  computed  according  to  Eq.  (A- 12)  in  Appendix  A 

(7)  Perform  linear  optimization  for  next  alternative  selec- 
tion. Select  the  next  alternative  by  optimizing  Eq. 
(III-13)  over  all  remaining  alternatives. 

(8)  Test  for  termination  (optional).  Ask  the  DM  to  care- 
fully consider  each  of  his  most  recent  tradeoff  ratios 
and  the  range  of  MOE  values  covered  by  the  remaining 
alternatives.  Determine  whether  he  would  modify  any  of 
these  tradeoff  ratios  as  a function  of  the  MOE  values 
within  this  range.  If  he  would  not,  the  choice  must  be 
made  between  the  alternative  determined  in  Step  7 and 
the  current  highest-ranking  alternative.  Of  these  two, 
the  preferred  one  is  the  alternative  which  optimizes  the 
linear  function — Eq.  (III-13).  At  this  point,  the  most 
preferred  alternative  has  been  identified  and  we  are 
done.  If  the  DM  indicates  that  his  tradeoff  ratios  are 
not  constant  over  the  range  of  MOE  values,  proceed  to 
Step  2 with  the  current  highest-ranking  alternative  and 
the  alternative  obtained  in  Step  7. 
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IV  DEVELOPMENT  OF  MEASURES  OF  EFFECTIVENESS  FOR  LOGISTICS 

A.  General 

As  discussed  earlier,  one  of  the  three  objectives  of  this  research  was 
to  identify  and  develop  measures  of  effectiveness  (MOE)  models  for  one  key 
logistics  technical  area.  We  decided  to  focus  on  one  technical  area  due  to 
the  complexity  of  the  naval  logistics  system,  and  the  interactions  among 
the  various  technical  areas.  By  selecting  this  course,  we  could  arrive  at 
the  point  of  describing  alternative  ED  programs  in  terms  of  their  multi- 
attribute structure  much  earlier.  We  could  then  construct  a specific  ex- 
ample, and  determine  how  the  proposed  resource  allocation  method  would  be 
applied.  This  would  allow  us  to  evaluate  the  usefulness  of  the  method, 
and  the  course  to  pursue  to  apply  it  to  other  logistics  technical  areas. 

The  Logistic  Supply  System  Segment  of  the  Technical  Strategy  for  Logis- 
tics and  Facilities  was  chosen  for  this  purpose  after  several  discussions 
with  the  sponsor  of  this  research.  In  this  segment  of  the  strategy,  a num- 
ber of  projects  were  currently  under  way,  and  the  consequences  of  supple- 
mental funding  alternatives  would  be  of  more  than  academic  interest.  In 
addition,  a number  of  new  starts  were  also  being  considered.  These  projects 
are  shown  in  Table  IV-1  together  with  test  case  funding  levels,  and  conjec- 
tured supplemental  or  new  funding  amounts.  These  projects  are  designated 
Cl  through  CIO,  respectively. 

In  Table  IV-2,  the  conjectured  present  funding  and  postulated  add-on 
funding  structure  is  illustrated  to  form  the  basis  for  developing  alterna- 
tive ED  programs.  Note  in  Table  IV-2  that  projects  C2  and  C8  have  been  de- 
leted from  the  list.  C2  was  dropped  because  one  of  the  primary  MOEs 
identif ied--responsiveness--did  not  apply  to  this  project,  and  in  any 
case  no  new  add-ons  were  being  considered.  Thus,  inclusion  of  C2  would 
require  the  introduction  of  new  MOEs  but  would  not  affect  any  possible 
ED  funding  decisions.  Other  projects  in  the  list  also  would  not  affect 
funding  decisions  (i.e.,  Cl,  C3,  and  C6) , but  these  were  retained  because 
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Table  IV- 1 


SUPPLY  SYSTEM  PROJECTS 


Proj  ect 
Number 

Project 

Cost 

(thousands 
of  dollars) 

Cl 

Vehicle  Scheduler 

$ 120 

C2 

Transportation  of  Personal  Effects 

500 

C3 

Material  Distribution  System 

280 

C4 

Container  Network  Analysis 

100 

(50)" 

C5 

Information  and  Material  Movement 
System 

210 

(200) 

C6 

Warehousing 

130 

C7 

Parcel  Handling 

80 

(200) 

1 

New  Starts 

C8 

Resource  Allocation  Methodology 

(200) 

C9 

Multi-Echelon  Repairables 

(300) 

CIO 

Interwarehouse  Transport 

(300) 

: ■ 
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Table  IV- 2 

SUPPLY  SYSTEM  PROJECT  FUNDING 
(Thousands  of  Dollars) 


Present  Funding 


Project 

Cl 

$120 

Project 

C3 

280 

Project 

C4 

100 

Project 

C5 

210 

Project 

C6 

130 

Project 

C7 

80 

Proj  ect 

C9 

— 

Project 

CIO 

-- 

Note:  C2  and  C8  omitted 


$ 920 


Total  Postulated  Add-ons 


Project 

C4 

$ 50 

Note:  C4, 

C5,  C7  are 

Project 

C5 

200 

add-ons  to 

already  committed 

Proj  ect 

C7 

200 

programs. 

programs. 

C9,  CIO  are  new 

Project 

C9 

300 

Proj  ect 

CIO 

300 

$1050 

Total , 

with 

add-ons 

$1970 

Intermediate  Increments 


■25%  - 

$1182 

Add-on 

($262) 

50%  - 

1445 

(525) 

■75%  - 

1707 

(787) 

; I 


YS 
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their  MOEs  were  consistent  with  the  other  projects.  C8  represents  funds 
that  would  be  allocated  to  pursue  this  type  of  resource  allocation  method 
study.  The  principal  MOE  for  this  type  of  project  would  be  related  to 
dollars  saved  on  misdirected  projects.  This,  of  course,  would  be  very 
difficult  to  estimate,  and  whatever  one  might  estimate  would  be  subject 
to  an  uncertainty  much  out  of  line  with  what  outcomes  one  might  estimate 
from  the  remaining  projects.  For  these  reasons  and  with  the  consent  of 
the  sponsor,  projects  C2  and  C8  were  deleted  for  the  purpose  of  this 
research. 

From  Table  IV-2  we  see  that  the  present  funding  level  is  $920K  with 
postulated  add-ons  of  $1050K.  We  decided  to  consider  three  intermediate 
levels  of  postulated  add-ons.  At  the  25%,  50%,  and  75%  level,  these 
correspond  to  $262K,  $525K,  and  $787K  add-on  budgets.  With  these  incre- 
mental budget  amounts,  a number  of  alternative  ways  of  funding  can  be 
formed.  These  are  shown  in  Table  IV-3.  Note  that  the  funding  level  for 
each  alternative  at  each  budget  level  only  approximates  the  three  dollar 
values  given  above.  Table  IV-3  shows  that  at  the  25%  increment  budget 
we  can  construct  four  alternative  programs  which  consist  of  funding  add- 
ons in  C4  and  C5,  or  C4  and  C7,  or  C9,  or  CIO.  (The  funding  levels  do 
not  exactly  equal  the  25%  increment  amount,  but  approximate  it  as  shown.) 
For  the  50%  increment  budget,  we  have  five  alternative  programs,  and 
finally  for  the  75%  increment  budget  we  have  four  alternative  programs. 

For  each  incremental  budget  level,  we  must  now  ask  which  of  the 
program  alternatives  is  most  preferred  by  the  DM?  To  answer  this  ques- 
tion, the  following  steps  must  be  performed.  First,  the  important  de- 
cision MOEs  related  to  the  outcomes  of  the  alternative  programs  must  be 
identified  and  modeled  in  terms  of  lower-order  MOEs  where  applicable. 
Next,  the  DM  employs  some  method  to  assess  his  preferences  and  tradeoffs 
among  the  MOEs,  and  to  select  the  most  preferred  program.  The  DM  can 
then  integrate  the  information  generated  in  the  previous  step  to  develop 
his  rationale  for  his  choice. 

Through  the  course  of  several  discussions  with  the  sponsor,  the 
following  common  view  of  the  MOE  identification  and  selection  process 
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Table  IV- 3 

INCREMENTAL  BUDGET  ED  PROGRAMS 
(Thousands  of  Dollars) 


25%  Increment 

Programs 

Alternative 

I 

II 

III 

IV 

Project  C4 

: $ 50 

C4: 

$ 50 

C9 : 

$300 

CIO: 

$300 

C5 

: 200 

C7: 

200 

Total 

$250 

$250 

$300 

$300 

50%  Increment 

Programs 

Alternative 

I 

II 

III 

IV 

V 

Project  C4 

: $ 50 

C4 : 

$ 50 

C4: 

$ 50 

C4 

$ 50 

C9 : 

$300 

Project  C5 

: 200 

C5 : 

200 

Cl: 

200 

C7 

200 

CIO: 

300 

Project  C9 

: 300 

CIO: 

300 

C9 : 

300 

CIO 

300 

Total 

$550 

$550 

$550 

$550 

$600 

75%  Increment 

Programs 

Alternative 

I 

II 

III 

IV 

Project  C4 

: $ 50 

C4 : 

$ 50 

C5 : 

$200 

C7 

$200 

Project  C5 

: 200 

C5 : 

200 

C9: 

300 

C9 

300 

Project  C7 

: 200 

Cl: 

200 

CIO: 

300 

CIO 

300 

Project  C9 

: 300 

CIO: 

300 

Total 

$750 

$750 

$800 

$800 

was  reached.  There  is  a hierarchy  of  MOEs  that  measure  effectiveness 
at  various  echelons  of  Naval  activity.  Those  MOEs  at  the  highest  eche- 
lon are  seldom  useful  in  identifying  specific  problems  and  possible  so- 
lution approaches.  On  the  other  hand,  they  do  indicate  that  problems 
exist  somewhere  in  the  system,  and  their  values  indicate  the  magnitudes 
of  the  problems.  Thus,  they  serve  as  meaningful  measures  of  the  out- 
comes of  various  solution  approaches,  once  these  solution  approaches 
are  formulated  and  their  effects  on  modifying  the  values  of  the  MOEs 
are  evaluated. 
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At  lower  echelons  of  activity  the  MOEs  become  more  and  more  specific 
and  detailed,  and  are  therefore  more  directly  related  to  the  problems  in 
the  systems.  Thus,  they  are  useful  in  formulating  solution  approaches, 
but  may  not  be  very  useful  in  measuring  how  well  the  system  problem  seen 
at  a higher  echelon  has  been  solved. 

Decision  makers  at  any  given  level  of  activity  are  of  course  con- 
cerned with  both  sets  of  MOEs.  The  lower-echelon  MOEs  allow  the  DM  to 
identify  specific  problem  areas,  and  guide  the  formulation  of  appropriate 
solutions,  while  the  higher-echelon  MOEs  allow  him  to  assess  how  well  the 
system  problem  would  be  solved  with  any  given  course  of  action  (i.e.,  ED 
program).  Thus,  we  will  henceforth  refer  to  the  lower-echelon  MOEs  as 
Project  MOEs,  and  the  higher-echelon  MOEs  as  the  Strategy  MOEs. 

Strategy  MOEs  are  of  course  related  to  the  Project  MOEs.  The  rela- 
tionships must  be  identified,  understood,  and  modeled  so  that  we  can  then 
compute  the  effect  of  each  proposed  ED  program  on  the  Strategy  MOEs 
through  their  effects  on  the  Project  MOEs.  If  only  one  Strategy  MOE 
existed,  and  its  dependence  on  a set  of  Project  MOEs  could  be  determined, 
the  resource  allocation  decision  would  involve  simply  selecting  that  ED 
program  providing  the  greatest  value  of  the  Strategy  MOE.  Unfortunately, 
a number  of  Strategy  MOEs  exist,  and  the  resource  allocation  decision 
must  involve  a tradeoff  process  among  the  various  Strategy  MOEs. 

We  proceeded  by  making  a first  cut  at  identifying  MOEs  for  measuring 
the  outcomes  of  the  various  supply  system  projects  listed  in  Table  IV-1. 

A total  of  12  potential  MOEs  were  initially  identified.  However,  after 
reviewing  these,  it  became  evident  that  this  list  of  MOEs  contained  a 
mix  of  MOE  hierarchies.  We  then  modified  this  list  and  narrowed  it  down 
to  an  initial  set  of  five  Strategy  MOEs. 

Table  IV-4  summarizes  this  process  and  shows  the  relationships 
among  the  Strategy  MOEs  and  the  eight  supply  system  projects.  These 
Strategy  MOEs  are  spelled  out  in  the  paper  entitled  "Technical  Strategy 


Table  IV-4 


■i 


PROJECT  VERSUS  STRATEGY  MOEs 


Cj  = Capital  investment  costs 


OMN 


Costs  In  OWN 


M = Total  manpower  required 


Mg  = Skilled  manpower  required 


Responsiveness 


Project 

Number 


Cl 


C3 


C4 


C5 


C6 


C7 





Previously  Identified 
Project  MOEs 


Number  of  vehicles 
required 


Even  workload 


Equipment  utilization 
efficiency 


Reduced  planning  time 


Responsiveness 


Dollars  saved  in 
capital  investment 


Dollars  saved  in 
capital  investment 


Responsiveness 


Responsiveness 


Dollars  saved  in 
capital  investment 


1-NORS 


Dollars  saved  in 
capital  investment 


Dollars  saved  in 
operating  costs 


Strategy 

MOEs 


OMN 


‘'OMN 


OMN 


OMN 


Rationale 


Saves  on  the  costs  of  vehicles 

Reduces  OMN  costs  because  of  fewer  vehicles 

Reduces  manpower  required 


Reduces  overtime/manpower  costs 


Reduces  required  manpower  due  to  greater 
efficiency 


Reduces  delays  due  to  workload  saturation 


Reduces  delays  due  to  idle  equipment 


Reduces  skilled  manpower  required 

Reduces  manpower  costs 

Improved  planning  reduces  delays 


NOR  is  directly  related  to  time  awaiting 
parts  or  material,  which  is  measured  by 
responsiveness 


Speeds  up  acquisition  of  material  from 
warehouse 
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Table  IV-A  (Concluded) 


Project 

Number 

Previously  Identified 
Project  MOEs 

Strategy 

MOEs 

Rationale 

C7 

(Concl . ) 

Control/ visibility 

R 

COMN 

Control  reduces  delays  by  locating  material 
or  parts 

Reduces  costs  due  to  shipment  losses 

M 

Reduces  manpower  to  locate  material 

Responsiveness 

R 

C9 

Dollars  saved  in  CMN 

COMN 

Floor  space  and 
volume  in  warehousing 

CI 

COMN 

Reduces  need  to  build  additional  warehouses 

Reduces  cost  of  operating  additional 
warehouses 

Reduction  in  inventory 

R 

COMN 

M 

May  reduce  responsiveness  due  to  lack  of 
item  in  inventory  at  user  echelon  or  in 
the  system 

Reduces  dollars  tied  up  in  inventory  items 
and  maintaining  inventory 

Possible  change  in  manpower  required 

CIO 

Manpower 

M 

COMN 

Reduces  manpower  costs 

Responsiveness 

R 

I! 


*7 


r* 


. i 

! 
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for  Exploratory  Development  in  Logistics."  For  the  supply  system,  the 
need  is  stated  to  "improve  supply  system  responsiveness  at  reduced  cost 
and  manpower."  Responsiveness  is  measured  in  supply  cycle  time,  the 
elapsed  time  from  when  a user  generates  a request  for  parts  or  material 
to  the  time  he  receives  the  requisitioned  items.  Cost  is  broken  down 
into  06MN  and  capital  investment  dollars.  Finally,  manpower  is  broken 
down  into  total  manpower  and  skilled  manpower. 

Further  consideration  of  responsiveness,  as  measured  by  supply  cycle 
time,  led  to  the  recognition  that  supply  cycle  time  was  highly  dependent 
on  the  situation  or  scenario  being  considered.  For  example,  when  one 
aims  at  improving  the  response  time  for  a repair  shop  to  obtain  a small 
spare  part,  a reduction  in  response  time  of  hours  may  be  significant, 
whereas  for  the  acquisition  of  a major  system  component  such  as  a new 
or  overhauled  jet  engine,  one  looks  for  response  time  reductions  on  the 
order  of  days.  Thus,  we  cannot  simply  average  together  these  different 
response  times  to  measure  the  effect  of  all  improvements  in  the  system. 

We  concluded  that  response  time  should  be  categorized  by  several 
scenarios  that  bring  out  the  types  of  response  time  savings  expected 
from  the  set  of  candidate  projects.  The  expected  response  times  in  each 
scenario  are  then  considered  as  separate  MOEs. 

Also  at  this  point,  with  the  approval  of  the  sponsor,  we  decided 
not  to  attempt  to  model  the  manpower  Strategy  MOEs.  This  was  done  to 
bound  the  MOE  modeling  problem  and  to  focus  on  modeling  the  responsive- 
ness and  cost  MOEs. 

The  supply  scenarios  consisted  of  the  five  scenarios  described  in 
Table  IV-5,  These  scenarios  are  designated  Al,  A2,  B,  C,  and  D,  re- 
spectively. Scenario  Al  applies  to  the  case  of  a small  parts  requisition 
by  a repair  shop  from  an  LSP  or  an  NLSP,  if  the  part  is  not  available  at 
the  LSP.  Scenario  A2  is  similar  in  that  it  applies  again  to  the  case  of 


"Technical  Strategy  for  Exploratory  Development  in  Logistic s,"  David  W. 
Taylor  Naval  Ship  Research  and  Development  Center,  Bethesda,  MD  (25 
February  1977). 


SUPPLY  SCENARIOS 


a small  parts  requisition,  but  onboard  a ship  at  sea.  In  this  case,  the 
LSP  is  the  ship's  own  supply  stocks,  and  the  NLSP  is  another  ship's  sup- 
ply stocks.  The  second  ship  is  assumed  to  be  in  the  same  task  force  as 
the  ship  requiring  the  repair  part.  These  two  scenarios  are  quite  simi- 
lar as  their  designation  implies,  but  they  were  kept  separate  because  of 
the  difference  in  urgency  between  the  two  cases. 

Scenario  B is  a heavy  equipment  requisition  from  an  NLSP  by  an  air- 
craft maintenance  shop  or  a shipyard.  Scenario  C is  a high-volume, 
normal  supply  requisition  from  an  NLSP.  Finally,  Scenario  D covers  the 
case  of  underway  replenishment  at  sea. 

Through  the  process  described  above  we  arrived  at  the  following  set 
of  seven  Strategy  MOEs  for  use  in  the  supply  system  ED  program  selection 
task: 


(1) 

rai 

= 

Expected 

response 

time 

in 

Scenario 

A1 

(2) 

RA2 

= 

Expected 

response 

time 

in 

Scenario 

A2 

(3) 

"b 

= 

Expected 

response 

time 

in 

Scenario 

B 

(4) 

Rc 

= 

Expected 

response 

time 

in 

Scenario 

C 

(5) 

rd 

= 

Expected 

response 

time 

in 

Scenario 

D 

(6) 

CI 

= 

Capital 

investment 

: costs 

(7) 

COMN 

= 

Operations  and  maintenance 

Navy  costs. 

The 

remainder  of  this  section 

deals 

with  the  construction  of  a re 

sponsiveness  model  to  measure  the  expected  response  time,  and  a descrip- 
tion of  the  cost  model  used  to  measure  the  costs. 

B.  The  Responsiveness  Model 

A simple  expected  value  model  has  been  developed  that  relates  re- 
sponsiveness (system  response  time)  to  various  program  level  MOEs  by 
means  of  selected  system  delay  times.  Figure  IV-1  presents  a flowchart 
depicting  the  generic  supply  process  used  as  a basis  for  the  model. 
Appropriate  delay  times  and  branch  probabilities  are  indicated  on  the  flow- 
chart. These  variables  are  defined  in  Table  IV-6. 
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MATERIAL  OR  PART 
(M/P) 

REQUISITIONED 


REQUISITION 
RECEIVED  AT  LSP 


M/P  AT  LSP 


M/P  NOT  AT  LSP 


DPI  + TPl 


M/P  PREPARED 
FOR  SHIPMENT 


DELIVERY  VEHICLE 
SCHEDULED 


DTI  + TT1 


DELIVERY  VEHICLE 
ARRIVES 


DL1  + TL1 


M/P  LOADED 
AND  SHIPPED 


DD1  + TD1 


M/P  NOT 
DELIVERED 


M/P 

DELIVERED 


DU1  + TUI 


M.  P 

REORDERED 

M/P 

UNLOADED 

1 

SUBSTITUTE 
AT  LSP 


(1  - PS) 


SUBSTITUTE 
AT  LSP 


M/P  LOCATED 
AT  NLSP 


^”(same  as  for  block  (A)"^ 

I but  for  NLSP)  I 

I I 

DP  2 + TP2 

I I 

TS2 

' DT2 + TT2  ‘ 

DL2  + TL2  ‘ 

DD2  + TD2  ' 

1 PD2  ‘ 

DW2  ! 

1 DU 2 + TU2  1 

I I 


INCORRECT  OR 
DAMAGED  M/P 

CORRECT  M/P 

LSP  - LOCAL  SUPPLY  POINT 

NLSP  = NON-LOCAL  SUPPLY  POINT 

FIGURE  IV-1 

RESPONSIVENESS 

MODEL  FLOWCHART 

f 


Table  IV-6 


RESPONSIVENESS  MODEL  INPUT  PARAMETERS 


= Initial  requisition  processing  time 
= Delay  time  prior  to  material  location  process 
= Time  to  determine  whether  or  not  material  is  at  LSP 
= Time  to  determine  whether  or  not  substitute  is  at  LSP 


= Time  to  locate  material  at  NLSP 


DPI  & DP2  = 


TP1  & TP2  = 
TS1  & TS2  = 
DTI  & DT2  = 


Delay  time  prior  to  transportation  scheduling/shipment 
preparation 

Time  to  prepare  material  for  shipment 
Time  to  schedule  vehicle  for  transportation 
Delay  time  until  a vehicle  is  available 


TT1  & TT2  = Vehicle  transit  time 

DL1  & DL2  = Delay  time  before  vehicle  is  loaded 

TL1  & TL2  = Material  load  time 


DD1  & DD2  = 
TD1  & TD2  = 
DW1  & DW2  = 


Delay  time  prior  to  or  during  shipment 
Delivery  time  for  shipment 

Waiting  time  before  undelivered  material  is  recorded 


DU1  & DU2  = Delay  time  prior  to  unloading  material  at  user  location 

TUI  & TU2  = Material  unload  time 

PI  = Probability  that  material  is  available  at  LSP 

PS  = Probability  aht  substitute  is  available  at  LSP,  given 
material  is  not  at  LSP 


PD1  & PD2  = 


Probability  that  material  is  delivered,  given  that  it 
was  shipped 

Probability  that  material  received  is  correct  and 
undamaged  material 


Note  that  for  the  remaining  parameters,  the  suffix  1 refers  to  the 
delivery  from  an  LSP,  and  2 refers  to  the  delivery  from  an  NLSP. 


) 


The  process  begins  with  the  submittal  of  a material  requisition 
that  arrives  at  an  inventory  control  point  (ICP)  after  a time  delay  of 
TR  time  units.  A search  is  then  conducted  to  locate  the  material  in 
inventory.  However,  it  is  assumed  that  the  search,  which  takes  an  amount 
of  time  TF1,  is  not  initiated  until  after  some  delay  time  DFl.  The  delay 
time  would  generally  be  due  to  a backlog  of  orders  to  process.  If  the 
material  is  in  inventory  at  the  LSP  (with  probability  PI),  the  material 
is  prepared  for  shipment,  which  takes  TP1  time  units,  after  another  delay 
time  of  DPI.  At  that  point  transportation  is  scheduled,  a process  re- 
quiring TS1  time  units.  After  some  delay  time  DTI,  the  transportation 
vehicle  is  available  and  proceeds  to  the  pickup  point  in  the  time  TT1. 
Prior  to  loading,  another  delay  time  of  DL1  may  occur,  after  which  the 
material  is  loaded  in  the  time  TL1.  The  transportation  of  the  material 
to  the  user  requires  a minimum  time  of  TD1,  but  a delay  enroute  of  DD1 
may  also  occur.  Since  the  material  being  shipped  may  get  lost  enroute 
or  be  delivered  to  the  wrong  destination,  there  is  a probability  PD1 
that  the  material  will  be  delivered.  At  this  time  the  material  is  un- 
loaded in  a time  of  TUI  after  some  delay  DU1.  Since  the  material  may 

or  may  not  be  useful  as  delivered,  there  is  a probability  PC  that  it  is 

correct  and  undamaged,  and  the  supply  cycle  is  ended. 

With  probability  1-PC  the  material  is  incorrect  or  damaged  and  the 
supply  cycle  must  be  repeated  with  the  submittal  of  another  requisition. 

If  the  material  is  not  delivered  (with  probability  1-PDl),  a certain 
waiting  time  passes  before  the  material  is  reordered.  This  time  is 
designated  DWl. 

If  the  material  is  not  available  at  the  LSP  (with  a probability 
1-PI),  then  there  is  a possibility  that  a suitable  alternate  or  substi- 
tute material  can  be  provided  from  the  LSP.  The  determination  of  this 

requires  TF2  time  units,  and  the  probability  of  this  event  is  PS. 

With  a probability  of  1-PS,  no  substitute  will  be  available  at  the 
■i  LSP,  and  the  material  will  have  to  be  ordered  from  an  NLSP.  In  this 

event,  the  determination  of  the  location  of  the  NLSP  from  which  the  ma- 
terial must  be  ordered  requires  TF3  time  units.  The  remaining  process 
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is  assumed  to  be  identical  with  the  shipment  of  the  material  from  an  LSP 
except  that  the  times  required  for  the  various  steps  may  be  different. 
These  NLSP  times  are  designated  with  the  same  notation  as  used  for  the 
LSP  case,  except  that  the  final  character  in  the  notation  is  a 2 rather 
than  a 1.  Thus,  for  example,  the  material  preparation  time  and  the  de- 
lay time  are  designed  TP2,  and  DP2,  respectively. 

The  process  as  described  above  can  continue  through  the  various 
steps  a number  of  times,  depending  on  the  various  branching  probabili- 
ties. However,  the  probability  of  more  than  two  iterations  will  be  low, 
and  for  the  purpose  of  the  numerical  example  to  be  presented  in  the  next 
section,  we  have  assumed  that  after  the  second  pass  through  the  process, 
the  correct  material  will  be  delivered  either  from  the  LSP  or  the  NLSP. 

The  above  restrictions  permit  us  to  calculate  the  expected  response 
time  by  considering  only  nine  cases.  These  cases  are  identified  in 
Table  IV-7.  For  each  case,  the  response  time  equation  and  its  corre- 
sponding probability  of  occurrence  are  indicated.  At  the  end  of  Table 
IV-7,  the  system-response-time  equation  is  given. 

C.  The  Cost  Model 

The  cost  MOEs  are  related  to  capital  investment  costs,  C^,  and 
operations  and  maintenance,  Navy  costs,  C0MN*  These  costs  are  in  turn 
broken  down  into  the  categories  indicated  in  Table  IV-8.  Cost  factors 
in  capital  investment  are:  R&D,  facilities,  working  capital  changes, 
and  value  of  existing  assets  (employed  or  replaced).  Cost  factors  in 
06MN  are  personnel,  maintenance  and  repair,  materials,  supplies,  hand- 
ling, etc.,  and  overhead.  The  cost  model  considers  only  changes  in 
these  cost  factors  that  would  be  expected  in  the  future  if  a particular 
ED  project  is  funded.  The  applicability  of  each  type  of  cost  factor  to 
each  ED  project  considered  in  this  example  is  indicated  by  the  entries 
in  Table  IV-8.  Savings,  when  they  occur,  are  indicated  in  parentheses. 
Note  that  for  the  value  of  existing  assets  (employed  or  replaced),  only 
the  values  can  be  counted  that  result  from  the  use  or  release  of  existing 
assets  that  can  be  gainfully  employed  in  some  other  activity. 
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Table  IV-7 


RESPONSIVENESS  MODEL  EQUATIONS 


Case  1.  Normal  Delivery  from  LSP 


T„  = TR  + DFl  + TF1  + DPI  + TP1  + TS1  + DTI  + TT1  + DL1  + TL1  + DD1  + TD1  + DU1  + TUI 
N 


PN  = (PI)(PD1)(PC) 

Case  2.  Incorrect  or  Damaged  Delivery  from  LSP 


T = 2 T 
D N 

PQ  = (PI) (PDl) ( 1 - PC) 

(We  assume  that  if  Case  2 occurs,  it  is  followed  by  a Case  1 delivery  with 
certainty. ) 

Case  3.  Material/Part  Lost  or  Diverted  in  Shipment  from  LSP 


Tt  = T„  + TR  + DFl  + TFl  + DPI  + TP1  + TS1  + DTI  + TT1  + DL1  + TL1  + DD1  + TD1  + DW1 
L N 

PL  = (PI)(1  - PDl) 

(We  assume  that  if  Case  3 occurs,  it  is  followed  by  Case  1 with  certainty.) 

Case  4.  Normal  Substitute  Delivery  from  LSP 


T = T + TF2 
NS  N 

PMO  = (1  - PI) (PS) (PDl) (PC) 

NS 

Case  5.  Incorrect  or  Damaged  Substitute  Delivery  from  LSP 


TDS  = TD  + 2(TF2) 

PDS  = (1  - PI)(PS)(PD1)(1  - PC) 

(We  assume  that  if  Case  5 occurs,  it  is  followed  by  Case  4 with  certainty.) 


Case  6.  Substitute  Lost  or  Diverted  in  Shipment  from  LSP 


COST  FACTORS 


Parentheses  indicate  savings 


The  expected  change  in  operations  and  maintenance.  Navy  cost 
(AC^^),  is  computed  on  an  annual  basis  and  is  given  by 

ACOMN  = acpers  + acm&r  + ACMSH  + acoh  (IV-1) 

Expected  annual  cost  change  attributable  to  changes 
in  personnel  requirements 

Expected  annual  cost  change  attributable  to  changes 
in  maintenance  and  repair  requirements 

Expected  annual  cost  change  attributable  to  changes 
in  materials,  supplies,  handling,  etc.  requirements 

Expected  annual  cost  change  attributable  to  changes 
in  overhead  requirements. 

Investment  costs,  for  comparison  of  alternative  systems,  are  usually 
normalized  to  an  equivalent  uniform  annual  investment  cost  over  the  ex- 
pected economic  lifetime  of  a system,  since  alternative  systems  will  in 

* 

general  have  unequal  expected  economic  lifetimes.  Thus,  for  this  study, 
the  investment  cost  MOE  is  the  expected  change  in  the  equivalent  uniform 
annual  investment  cost  (AC^.)  and  is  given  by 

4CI  ■ «Vd  + 4cfac  + 4c«cc  + aca)/els  <iv'2) 

where 

A^R&D  = Expected  research  and  development  costs  that  would 
be  incurred  if  a project  is  eventually  funded 

ACp^  = Expected  investment  cost  changes  attributable  to 
changes  in  facilities  requirements 

A^WCC  = Expected  investment  cost  changes  attributable  to 
changes  in  working  capital  requirements 

A^  = Expected  investment  cost  changes  attributable  to 
changes  in  existing  assets  requirements. 


where 


AC 


PERS 


AC, 


M&R 


AC, 


MSH 


AC 


OH 


Expected  system  economic  lifetime,  as  used  here,  refers  to  the  expected 
length  of  time  a system  will  operate  without  requiring  major  investment 
costs--e.g.,  replacement  of  computers  that  become  obsolete  or  mainte- 
nance prone  after  so  many  years. 


The  cost  MOEs  (AC^„,  and  ACX)  indicated  above  apply  to  a single  project. 
OMN  I 

The  ultimate  MOEs  used  in  applying  the  resource  allocation  methodology 
are  the  sums  of  each  of  these  over  all  the  projects  included  in  a given 
ED  alternative  program. 


V A SAMPLE  RESOURCE  ALLOCATION  PROBLEM 


To  provide  an  example  of  how  the  resource  allocation  method  would 
be  applied,  we  went  through  the  process  of  constructing  a numerical 
example  employing  the  responsiveness  and  cost  MOEs  applied  to  the  supply 
system  ED  projects.  For  this  example  we  first  defined  three  different 
budget  levels,  and  we  then  considered  several  alternative  programs  for 
allocating  the  funds  within  each  budget. 

A.  Budgets  and  Program  Alternatives 

The  numerical  example  is  based  on  an  evaluation  of  the  effects  of 
the  various  add-on  and  new  start  projects,  funded  to  the  levels  indicated 
in  Table  IV-2.  Three  incremental  budget  cases  were  considered.  These 
consisted  of  the  25%,  50%,  and  75%  increment  budgets.  For  each  of  these 
budget  levels,  the  add-on  and  new  start  projects  can  be  combined  in  vari- 
ous combinations  to  yield  various  alternatives  called  the  25%,  50%,  and 
757.  Increment  Programs.  These  are  shown  in  Table  IV-3. 

For  convenience,  the  add-on  or  new  start  projects  comprising  each 
alternative  are  shown  in  Table  V-l.  In  Table  V-l,  add-ons  are  identified 
with  a plus  sign  after  the  project  designation. 

From  Table  V-l  we  see  that  there  are  four  alternative  25%  Increment 
Programs,  five  alternative  50%  Increment  Programs,  and  four  alternative 
75%  Increment  Programs.  Since  each  of  these  alternatives  is  made  up  of 
various  combinations  of  add-on  projects,  more  combinations  are  available 
on  the  middle  level  of  funding.  It  is  important  to  note  that  there  are 
many  ways  to  form  these  alternative  programs.  In  addition  to  combining 
them  as  we  have,  there  is  also  the  possibility  of  trading  off  funding 
between  or  among  projects  in  various  ways  (this  may  be  feasible  only  for 
certain  projects). 
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Table  V-l 


SUPPLY  SYSTEM  ALTERNATIVE  ED  PROGRAMS 


257>  Increment 

Programs 

Alternative 

I 

II 

III 

IV 

Project 

C4+ 

C4+ 

C9 

CIO 

Project 

C5+ 

C7+ 

50%  Increment  Programs 

Alternative 

I 

II 

III 

IV 

V 

Project 

C4+ 

C4+ 

C4+ 

C4+ 

C9 

Project 

C5+ 

C5+ 

C7+ 

C7+ 

CIO 

Project 

C9 

CIO 

C9 

CIO 

757.  Increment 

Programs 

Alternative 

I 

II 

III 

IV 

Project 

C4+ 

C4+ 

C5+ 

C7+ 

Project 

C5+ 

C5+ 

C9 

C9 

Project 

C7+ 

C7+ 

CIO 

CIO 

Project 

C9 

CIO 

By  combining  the  effects  of  individual  project  add-ons  or  new  starts 
according  to  the  combinations  in  Table  IV-3,  we  were  able  to  derive  esti- 
mates of  the  effects  of  each  alternative  program  on  the  seven  MOEs  pre- 
sented in  Section  IV. 

B.  Responsiveness  MOE  Values 

We  built  up  the  numerical  example  by  first  estimating  the  present 
levels  of  all  the  responsiveness  MOEs.  These  numerical  values  as  well 
as  all  others  developed  are  simply  educated  guesses,  since  it  was  not 
the  purpose  of  this  initial  research  to  conduct  the  more  detailed  analysis 
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I 

I 


required  to  establish  these  numbers  with  more  confidence.  In  any  real 
application  of  this  method,  the  appropriate  supporting  analysis  must  be 
carried  out. 

Table  V-2  shows  our  estimates  of  the  present  levels  of  the  response 
parameters  identified  in  the  responsiveness  model  (Section  IV-A) . The 
response  time  units  are  in  minutes  of  working  day  time.  In  Table  V-2, 
several  response  time  parameters  are  grouped  on  one  line,  and  each  line 
is  numbered  with  a double-digit  number.  The  reason  for  these  groupings 
was  to  fit  the  memory  constraints  of  the  Texas  Instruments  SR-52  calcu- 
lator. The  responsiveness  model  equations  were  programmed  on  the  SR-52 
to  facilitate  the  calculation  of  the  expected  response  time  in  each  sce- 
nario. The  SR-52  advertises  20  addressable  memory  locations,  but  actu- 
ally has  two  additional  memory  locations.  The  first  20  are  addressed  as 
00  through  19,  and  the  other  two  are  98  and  99.  Thus,  in  Table  V-2,  each 
line  corresponds  to  a particular  SR-52  memory  location  with  the  indicated 
double-digit  address.  This  program  is  listed  in  Appendix  B. 

Scenario  A1  is  the  case  of  a small  requisition  from  either  an  LSP 
or  an  NLSP.  This  type  of  scenario  involves  all  the  individual  response 
times  in  the  responsiveness  model.  Thus,  in  Table  V-2,  all  response  time 
and  probability  parameters  have  been  assigned  an  estimated  value. 

Scenario  A2  is  the  repair-at-sea  requisition  from  an  LSP  or  NLSP. 

The  LSP  in  this  case  is  simply  the  ship's  own  organic  repair  supplies, 
and  the  NLSP  is  another  ship  within  the  same  task  force  or  group.  Thus, 

A2  is  similar  to  A1  except  for  the  inherent  close  proximity  of  the  user 
and  the  supplier,  and  the  criticality  of  the  repair  need.  In  particular, 
we  have  set  the  probability  of  non-delivery  from  the  LSP,  given  the  avail- 
ability of  the  required  part  (1-PD1)  equal  to  zero.  Thus,  the  value  of 
DW1,  the  waiting  time  before  reordering,  is  irrelevant,  and  we  have  set 
it  equal  to  zero.  In  addition,  there  are  a number  of  delay  time  param- 
eters that  have  been  set  equal  to  zero  to  account  for  the  immediacy  of 
the  need  for  repair  when  at  sea. 


Scenario  B is  the  heavy  equipment  requisition  from  the  NLSP.  In 
this  scenario  all  the  response  time  and  probability  parameters  relating 
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RESPONSE  PARAMETER  VALUES --PRES ENT  LEVEL 


Expected  Response  Time 

Minutes  815.0  135.9  3208.4  2740.0  21300.0 


to  delivery  from  the  LSP  do  not  apply,  as  indicated  by  the  dash  in  the 
appropriate  box  in  Table  V-2.  This  is  equivalent  to  a zero  value  of 
these  parameters  in  the  expected  response  time  computation.  In  addition, 

PI  and  PS,  the  probabilities  of  availability  at  the  LSP  of  the  required 
material  or  substitute,  respectively,  must  be  zero  according  to  the  sce- 
nario assumption. 

Scenario  C is  the  high-volume  supply  requisition  from  the  NLSP. 

Again,  in  this  scenario,  the  response  times  and  probabilities  relating 
to  delivery  from  the  LSP  do  not  apply.  In  addition,  this  type  of  supply 
function  is  handled  in  a "push"  mode  where  deliveries  are  scheduled  at 
preplanned  intervals.  Thus,  the  user  cannot  directly  relate  to  the  re- 
sponsiveness of  the  system.  However,  from  the  supplier's  viewpoint,  the 
responsivness  of  the  system  is  quite  pertinent.  The  more  sluggish  the 
system,  the  more  resources  he  must  employ  to  meet  the  required  supply 
schedules.  This  can  be  partly  measured  in  terms  of  the  costs  involved 
in  operating  the  supply  system.  In  addition,  the  responsiveness  of  the 
system  will  certainly  affect  the  throughput,  or  amount  of  supply  material 
that  can  be  processed  through  the  system  over  a given  period  of  time  with 
a given  set  of  available  resources.  Thus,  in  retrospect,  a more  suitable 
unit  of  measuring  the  responsiveness  of  a "push"  type  of  supply  system 
should  be  developed.  However,  for  the  purpose  of  this  example,  we  will 
consider  only  the  expected  response  time  defined  from  the  viewpoint  of 
the  supplier  rather  than  the  user.  This  must  be  distinguished  from  the 
response  times  in  the  previous  three  scenarios,  which  are  defined  from 
the  user's  point  of  view. 

In  a "push"  supply  system  several  other  response  parameters  do  not 
apply.  One  such  parameter  is  DW2,  the  waiting  delay  time  before  reorder- 
ing supplies  that  have  not  been  delivered.  This  situation  is  handled 
in  the  responsiveness  model  by  setting  PD2  = 1.0  so  that  reordering  does 
not  occur.  Similarly,  PC  must  also  be  set  equal  to  unity  to  prevent  the 
reordering  cycle  from  occurring.  In  the  initiation  of  the  "push"  supply 
cycle,  only  two  processing  times  are  assumed  to  be  relevant.  First, 
there  is  a certain  amount  of  paper-processing  time  to  initiate  the 
supply  cycle,  and  a certain  amount  of  time  to  locate  the  required  material. 
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For  Scenario  C,  these  times  are  designated  TR,  and  TF3,  respectively, 
and  DF1,  TF1,  and  TF2  are  assumed  not  to  apply. 


The  last  scenario,  Scenario  D,  is  the  underway  replenishment  (UNREP) 
case.  Here  again  the  supplies  are  delivered  from  an  NLSP,  the  shore 
supply  facilities.  Thus,  the  response  time  and  probability  parameters 
for  the  LSP  case  do  not  apply,  and  PI  and  PS  are  zero.  As  in  Scenario  C, 
this  type  of  resupply  is  handled  in  a "push"  mode,  and  response  time 
must  be  interpreted  from  the  supplier's  point  of  view. 

To  obtain  estimates  of  the  effects  of  the  various  budget  levels  and 
the  corresponding  ED  programs,  we  first  developed  a table  showing  our 
estimates  of  which  response  times  in  which  scenarios  are  affected  by 
each  of  the  supply  system  projects.  This  information  is  shown  in  Table 
V-3.  Using  this  table,  we  were  able  to  develop  the  subsequent  tables, 
which  show  our  estimates  of  the  quantitative  effects  of  the  various 
programs . 

In  Table  V-3,  each  ED  project  is  listed  on  the  left-hand  side,  and 
each  column  to  the  right  corresponds  to  a particular  scenario.  Blanks 
indicate  that  the  corresponding  project  has  no  effect  on  any  of  the  re- 
sponse parameters  in  the  corresponding  scenario.  Where  effects  do  occur, 
the  response  parameters  are  identified,  and  the  direction  of  the  effect 
is  indicated  by  a plus  or  minus  to  indicate  an  increase  or  decrease. 
Negative  effect  on  response  times  and  positive  effect  on  probabilities 
are  preferred.  Note  that  in  some  cases  we  get  the  opposite  effect.  For 
example,  under  Scenario  C for  project  C3,  the  Material  Distribution 
Study,  we  can  anticipate  that  one  effect  may  be  to  consolidate  supply 
functions  by  closing  down  some  supply  facilities.  In  such  a case,  we 
can  expect  that  DD2  and  TD2,  the  response  times  associated  with  trans- 
porting material  from  an  NLSP,  will  be  increased  due  to  increased  dis- 
tances involved.  This  effect  should  be  more  than  compensated  for  by 
improvements  in  other  response  parameters,  or  costs,  or  both. 

After  establishing  the  present  MOE  levels,  we  estimated  the  effects 
of  the  present  funding  of  the  ED  projects.  This  was  called  the  Base 
Program  case.  This  case  consists  of  the  present  funding  budget  shown 
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in  Table  IV-2.  These  effects  are  shown  in  Table  V-4.  In  Table  V-4, 
only  the  changes  in  the  response  parameters  affected  are  shown.  Table 
V-5  shows  the  new  response  parameter  values  for  the  Base  Program  case 
obtained  after  applying  the  changed  indicated  in  Table  V-4  to  the  values 
in  Table  V-2.  Also  shown  at  the  bottom  are  the  new  expected  response 
times,  and  the  changes  in  response  time  from  the  present  level. 

The  next  step  in  the  process  consisted  of  estimating  the  changes  in 
response  parameters  caused  by  each  of  the  various  add-on  projects.  These 
may  be  due  to  additional  funding  of  previously  funded  projects  or  the 
introduction  of  new  projects  (C9  and  CIO).  These  changes  are  shown  in 
Table  V-6,  and  the  changes  are  relative  to  the  Base  Program  response 
parameter  values.  In  certain  cases,  more  than  one  add-on  project  may 
affect  the  same  response  parameters.  When  this  occurs,  and  when  we  con- 
sider the  alternative  of  funding  both  projects,  a combined  effect  must 
be  estimated.  These  combined  effects  are  also  shown  in  Table  V-6  and 
are  not  necessarily  the  sum  of  the  individual  effects. 

We  note  in  Table  V-6  that  no  changes  occur  in  Scenario  B due  to  any 
of  the  add-on  projects.  This  means  that  the  expected  response  time  in 
Scenario  B does  not  enter  into  the  choice  from  among  the  set  of  alterna- 
tives. Scenario  B will  therefore  be  dropped  from  the  sample  problem. 
However,  if  this  were  actually  the  case,  the  decision  maker  might  want 
to  ask  his  staff  to  construct  a new  alternative  program  that  would  af- 
fect the  response  time  in  Scenario  B.  This  would  require  the  introduc- 
tion of  one  or  more  new  projects. 

Using  the  information  in  Table  V-6  to  modify  the  Base  Program  values 
in  Table  V-5  according  to  the  various  alternative  programs  defined  in 
Table  V-l,  we  can  complete  our  estimates  of  all  response  value  parameters. 
The  results  of  this  process  are  summarized  in  Table  V-7.  Here  we  show 
the  expected  response  times  for  each  of  the  scenarios  and  for  each  alter- 
native program.  As  a reference,  we  have  also  shown  the  results  for  the 
present  level,  base  Program,  and  100%  Increment  Program.  The  100%  Incre- 
ment Program  case  represents  only  one  alternative  way  to  allocate  the 
entire  add-on  budget.  Thus,  it  will  not  enter  into  any  tradeoff  assess- 
ments employing  the  proposed  method. 
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RESPONSE  PARAMETER  CHANGES— BASE  PROGRAM 
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Scenario 


Al 

(working 

hours) 

A2 

(working 

hours) 

C 

(working 

days) 

D 

(working 

days) 

Base  Programs 

9.7 

1.98 

5.84 

43.4 

25%  Increment  Programs 

Alternative  I 

9.7 

1.76 

5.71 

43.0 

Alternative  II 

8.7 

1.98 

5.71 

43.1 

Alternative  III 

10.1 

2.09 

5.84 

43.4 

Alternative  IV 

9.7 

1.98 

5.58 

40.5 

50%  Increment  Programs 

Alternative  I 

10.1 

1.86 

5.71 

43.0 

Alternative  II 

9.7 

1.76 

5.52 

40.4 

Alternative  III 

9.1 

2.09 

5.71 

43.1 

Alternative  IV 

8.7 

1.98 

5.52 

40.5 

Alternative  V 

10.1 

2.09 

5.58 

40.5 

75  Increment  Programs 

Alternative  I 

9.2 

1.86 

5.71 

Alternative  II 

8.7 

1.76 

5.52 

Alternative  III 

1.86 

5.58 

Alternative  IV 

9.2 

2.09 

5.58 

40.5 

100%  Increment  Programs 


9.1 


1.86 


5.52 


40.4 


Note  that  in  Table  V-7  we  have  modified  the  response  time  units  to 
working  hours  for  Scenarios  A1  and  A2,  and  to  working  days  for  Scenarios 
C and  D.  (A  working  day  is  assumed  to  consist  of  480  working  minutes.) 
This  was  done  because  of  the  large  spread  of  response  times  when  dealing 
strictly  in  working  minutes. 

A review  of  the  values  shown  in  Table  V-7  shows  that  although  fund- 
ing of  the  100%  Increment  Program  improves  the  responsiveness  in  all 
scenarios,  improvements  are  not  obtained  in  all  cases  for  all  interme- 
diate alternatives.  For  example,  comparing  Alternative  III  for  the  25% 
Increment  Program  to  the  Base  Program,  we  see  that  the  response  time  in 
Scenarios  A1  and  A2  is  expected  to  increase  with  additional  funding. 

This  is  primarily  because  this  particular  alternative  involves  adding 
on  project  C9,  which  is  the  Multi-Echelon  Repairables  Project.  This 
will  generally  require  transporting  the  requisitioned  material  over  a 
larger  distance  than  previously,  and  thus  increase  the  response  time. 

The  benefit  of  C9  will  be  primarily  in  cost  savings,  and  these  savings 
may  well  override  the  degraded  response  time. 

We  also  see  from  Table  V-7  that  certain  alternatives  dominate  others 
in  response  time  for  all  scenarios.  At  the  25%  Increment  Program,  Alter- 
native I dominates  III.  At  the  50%  Increment  Program,  Alternative  II 
dominates  both  I and  V.  Finally,  at  the  75%  Increment  Program,  Alterna- 
tive II  dominates  I,  III,  and  IV.  However,  since  cost  savings  have  not 
yet  been  considered,  we  cannot  as  yet  reach  any  conclusions. 

The  values  in  Table  V-7  for  the  various  alternative  programs  are 
the  responsiveness  MOEs  required  as  input  to  the  resource  allocation 
method.  As  discussed  earlier,  the  expected  response  time  in  each  sce- 
nario corresponds  to  a unique  MOE.  Thus,  Table  V-7  provides  four  of  the 
MOEs  required  for  ranking  the  supply  system  programs. 

Two  other  MOEs  are  required  before  the  RA  method  can  be  applied. 
These  are  the  capital  investment,  and  GM&N  costs.  Estimates  for  these 
costs  were  generated  next. 


c. 


Cost  MOE  Values 
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The  cost  model  described  in  Section  IV  is  designed  to  generate 
values  for  incremental  changes  in  equivalent  uniform  annual  investment 
costs  and  annual  O&MN  costs.  For  the  example  of  this  section,  the  al- 
ternative ED  programs  of  concern  are  defined  in  terms  of  incremental  ED 
budget  increases  over  and  above  that  which  is  already  committed--that 
is,  the  base  budget  as  previously  defined  by  the  present  funding  in 
Table  IV-2.  Thus,  values  for  the  cost  MOEs  AC_  and  AC__.  need  be  esti- 
mated  only  for  those  ED  projects  that  are  specified  for  possible  add-on 
funding  (C4,  C5,  C7,  C9,  and  CIO),  and  these  values  should  reflect  changes 
attributable  only  to  effects  of  the  add-on  funding  increments.  For  ED 
projects  C9  and  CIO,  these  are  both  totally  included  as  add-ons  and  thus 
can  be  handled  in  a straightforward  manner.  For  ED  projects  C4,  C5,  and 
C7,  the  add-on  funding  represents  increases  in  funds  already  committed. 

For  these  latter  cases,  the  changes  attributable  to  the  add-on  funding 
can  best  be  estimated  by  estimating  expected  MOE  values  attributable  to, 
first,  the  present  funding,  and  second,  the  total  funding  (present  plus 
add-on),  and  then  subtracing  the  former  from  the  latter. 

The  cost  MOE  values  are  derived  on  the  basis  of  "off  the  cuff"  as- 
sumptions as  to  future  ramifications  for  the  Naval  supply  system  that 
might  result  from  implementation  of  the  results  of  the  ED  projects. 

These  assumptions  are  not  based  on  any  analysis  and  simply  are  reflections 
of  what  might  be.  Table  V-8  presents  a number  of  these  assumptions  that 
indicate  some  ball-park  estimates  of  planning  factors  that  are  used  as  a 
basis  for  applying  cost  factor  estimates  to  obtain  the  values  for  the 
cost  MOEs. 

The  cost  factor  assumptions,  peculiar  to  each  ED  project,  used  to 
generate  the  cost  MOE  estimates  are  delineated  in  Table  V-9.  As  an 
example  only,  the  following  assumptions  were  made  to  segregate  the  future 
effects  of  the  two-stage  funding  projects.  For  Project  C4,  it  was 
assumed  that  the  present  level  of  ED  funding  would  lead  to  a medium-sized 
container  system  while  the  inclusion  of  add-on  ED  funding  would  lead  to 
a large-sized  container  system.  For  Project  C5,  it  was  assumed  that  the 
system  resulting  from  the  present  level  of  ED  funding  would  be  computerized 
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Planning  Factor  Area 


Supply  points 


Naval  ships  affected 
by  ED  projects 


Inventory 


Small  parcels 


Planning  Factor  Assumptions 


25  NLSPs 

(supply  centers,  supply  depots,  air 
stations,  and  shipyards) 

131  LSPs 

(all  supply  activities  including 
NLSPs) 


6 Logistic  ships 

213  Combatant  ships 
(excludes  submarines) 


$1.7  B total  affected  inventory 
(excludes  low-quantity  items  and 
afloat  required  spares) 

$170  M annual  loss  of  inventory 

$17  M annual  breakage  of  inventory 


10  M parcels  handled  per  year 

1000  miles  average  delivery 
distance 


5 lb  average  weight  per  parcel 


Table  V-9 


COST  FACTOR  ASSUMPTIONS 


ED  Project 

Cost  Factor  Assumptions 

C4 

Present  funding 
only  ($100K) 

INVESTMENT  COSTS 

No  additional  R&D  costs  above  ED  costs 

10  medium  containers  per  NLSP  ($3K  per  container) 

1 medium  container  loading  system  per  NLSP  ($10K  per  system) 

Training  of  6 personnel  per  NLSP  ($2.5K  per  person) 

15  year  estimated  system  economic  lifetime 

O&MN  COSTS 

System  maintenance  & repair  costs  (11%  of  equipment  investment  cost  per  year) 

20%  reduction  in  losses  and  breakage 

Total  Funding 

Present  + Add-on 
($150K) 

INVESTMENT  COSTS 

No  additional  R&D  costs  above  ED  costs 

10  large  containers  per  NLSP  ($6K  per  container) 

1 large  container  loading  system  per  NLSP  ($30K  per  system) 

Training  of  6 personnel  per  NLSP  ($2.5K  per  person) 

15  year  estimated  system  economic  lifetime 

O&MN  COSTS 

Maintenance  & repair  costs  (11%  of  equipment  investment  cost  per  year) 

40%  reduction  in  losses  and  breakage 

C5 

Present  funding 
only  ($210K) 

INVESTMENT  COSTS 

No  additional  R&D  costs  above  ED  costs 

1 large  computer  system  per  logistics  ship  ($65K  per  computer) 

Installation  of  computer  systems  ($5K  per  system) 

Training  of  2 personnel  per  logistics  ship  ($1K  per  person) 

10  year  estimated  system  economic  lifetime 

O&MN  COSTS 

Computer  system  maintenance  & repair  costs  (10%,  of  total  equipment  investment 
cost  per  year) 

Total  Funding 

Present  + Add-on 
($410K) 

INVESTMENT  COSTS 

No  additional  R&D  costs  above  ED  costs 

1 large  computer  system  per  logistics  ship  ($65K  per  computer) 

1 small  computer  system  per  combatant  ship  ($30K  per  computer) 

Installation  of  computer  systems  ($5K  per  large  computer  & $1K  per  small  computer) 
Training  of  2 personnel  per  logistics  & combatant  ship  ($1K  per  person) 

O&MN  COSTS 

10  year  estimated  system  economic  lifetime 

Computer  system  maintenance  & repair  costs  (10%  of  total  equipment  investment 
cost  per  year) 

C7 

Present  funding 
only  ($80K) 

INVESTMENT  COSTS 

No  additional  R&D  costs  above  ED  costs 

Parcel  handling  procedural  changes  ($2K  per  LSP) 

Training  of  10  personnel  per  LSP  ($1K  per  person) 

15  year  estimated  system  economic  lifetime 

O&MN  COSTS 

4 additional  personnel  per  LSP  ($30K  per  person  per  year) 

10%  reduction  in  inventory  losses  per  year 

Total  Funding 

Present  + Add-on 
($280K) 

INVESTMENT  COSTS 

No  additional  R&D  costs  above  ED  costs 

2 delivery  vehicles  per  LSP  ($12K  per  vehicle) 

Parcel  handling  procedural  changes  ($2K  per  LSP) 

Training  of  10  personnel  per  LSP  ($2.5K  per  person) 

6 sorters  per  LSP  ($5K  per  sorter) 

15  year  estimated  system  economic  lifetime 

O&MN  COSTS 

4 additional  personnel  per  LSP  ($30K  per  person  per  year) 

Sorter  & vehicle  maintenance  & repair  costs  (5%  of  equipment  investment  cost/year) 
Increased  transportation  costs  ($.00016  per  pound  per  mile) 

Reduced  postage  rates  ($1.50  per  parcel) 

50%  reduction  in  inventory  losses  per  year 

74 


i 


Table  V-9  (Concluded) 


COST  FACTOR  ASSUMPTIONS 


ED  Project 

Cost  Factor  Assumptions 

C9 

INVESTMENT  COSTS 

Total  Funding 

No  additional  R&D  costs  above  ED  costs 

($300K) 

Procedural  changes  ($4K  per  LSP) 

Training  of  10  personnel  per  LSP  ($1K  per  person) 

Respositlon  of  stockage  ($200K) 

10%  reduction  In  Inventory 

Decreased  facility  requirement  at  each  non-NLSP  LSP  ($50K  per  LSP) 

Increased  facility  requirements  at  each  NLSP  ($100K  per  NLSP) 

15  year  estimated  system  lifetime 

O&MN  COSTS 

Reduction  of  3 personnel  at  each  non-NLSP  LSP  ($30K  per  person) 

Increase  of  2 personnel  at  each  NLSP  ($30K  per  person) 

Increased  handling  & transportation  costs  (10%  of  inventory  savings) 

Facility  overhead  (75%  of  facility  requirements  costs  and/or  savings) 

CIO 

INVESTMENT  COSTS 

Total  Funding 

$750K  R&D  costs  In  addition  to  ED  costs 

($300K) 

1 system  per  NLSP  ($100K  per  system) 

System  installation  ($30K  per  system) 

Training  of  12  personnel  per  NLSP  ($5K  per  person) 

15  year  estimated  system  economic  lifetime 

06MN  COSTS 

Reduction  of  10  personnel  per  NLSP  ($30K  per  person  per  year) 

System  maintenance  & repair  costs  (15%  of  total  equipment  investment  cost/year) 

L-—  » - • #'- 


only  aboard  logistics  ships,  while  the  inclusion  of  the  add-on  funding 
would  result  in  automation  aboard  combatant  ships  also.  Finally,  for  Proj- 
ect C7,  the  present  level  of  ED  funding  is  assumed  to  lead  to  only  parcel 
handling  procedural  changes  at  LSPs , while  the  add-on  ED  funding  would 
presumably  lead  to  a total  parcel  handling  system  within  the  Naval  Supply 
system,  which  includes  base-to-base  transport  of  parcels  and  on-base  de- 
livery services. 

Using  the  planning  factor  and  cost  factor  assumptions  of  Tables  V-8 
and  V-9,  respectively,  as  inputs  to  the  cost  model  (Section  IV),  the 
values  of  the  cost  MOEs  associated  with  each  add-on  ED  project  were  com- 
puted. The  results  are  presented  in  Table  V-10.  These  results  then 
provided  the  basis  for  computing  the  cost  MOE  values  for  the  alternative 
ED  budget  allocations  by  appropriately  combining  the  project  MOE  values 
in  accordance  with  the  alternative  allocations  as  defined  in  Table  V-l. 

The  cost  MOE  values  for  these  alternative  ED  budget  allocations  are 
presented  in  Table  V-ll. 

D.  Application  of  the  RA  Method 

In  the  previous  sections  we  derived  numerical  examples  for  three 
incremental  budgets.  Each  budget  level  contained  four  to  five  alterna- 
tive ways  of  allocating  the  funds  to  the  various  add-on  ED  projects. 

For  each  alternative,  we  estimated  values  for  six  MOEs,  four  of  which 
were  supply  response  times  in  different  scenarios,  and  two  were  costs 
(or  savings)  resulting  from  successful  completion  of  the  projects.  The 
costs  were  broken  down  into  annualized  capital  investment  costs,  and 
annual  operations  and  maintenance,  Navy,  costs.  Table  V-12  summarizes 
the  estimated  MOE  values  for  each  alternative.  In  Table  V-12,  MOEs  are 
shown  in  response  time  increase  and  cost  increase  from  the  Base  Program 
case.  Thus,  negative  values  indicate  time  reductions  and  dollar  savings, 
and  negative  values  are  preferred  to  positive  values. 

The  changes  in  response  times  are  shown  in  minutes  for  Scenarios  Al, 

A2 , and  C,  and  in  hours  for  Scenario  D in  order  to  work  with  convenient 
magnitudes.  Cost  changes  are  shown  in  millions  of  dollars. 
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Table  V-10 


COST  MOE  ESTIMATES  FOR  ADD-ON  PROJECTS 


Add-On 

ED  Project 

Annual  Expected  Uniform 
Investment  Cost  Change 

ACi 

(thousands  of  dollars 
per  year)t 

Annual  Expected  O&MN 
Cost  Change 

AO&MN 

(thousands  of  dollars 
per  Year)+ 

C4 

$ 87 

($37,262) 

C5 

723 

639 

C7 

616 

(74,646) 

C9 

(11,364) 

6,860 

CIO 

387 

6,875 

Parenthesis  indicate  decreases  in  annual  costs. 
^Attributable  to  add-on  funding  only. 


For  the  25%  Increment  Program  we  see  that  no  alternative  dominates 
another  in  preference  for  all  MOEs.*  However,  Alternative  III  dominates 
the  others  only  in  C , the  capital  investment  costs.  In  particular, 
when  we  compare  Alternative  II  to  III,  the  large  savings  in  C^^  for  II, 
and  the  reduced  response  times  in  three  out  of  four  scenarios,  would 
probably  argue  for  an  a-priori  preference  of  II  over  III.  Similarly, 
one  can  argue  that  I may  also  be  preferred  to  III.  Preference  between 
III  and  IV  may  be  more  debatable.  Comparing  I and  II  to  IV  may  argue 
for  a bias  toward  I or  II  due  to  the  large  cost  savings  achieved  by  both. 
Thus,  a DM  may  indicate  an  a-priori  preference  for  the  pair  I and  II 
compared  to  all  other  possible  pairs.  These  then  appear  to  be  likely 
candidates  for  Step  1 in  the  tradeoff  assessment  method. 


The  preferences  indicated  in  the  remainder  of  this  section  are  based  on 
the  six  selected  MOEs.  Clearly,  use  of  other  MOEs  such  as  life  cycle 
cost  could  alter  these  preferences. 


Table  V-ll 


COST  MOE*  ESTIMATES  FOR  ALTERNATIVE  ED  BUDGET  ALLOCATIONS 


ACI 

(thousands  of  dollars 
per  year)’'' 

aComn 

(thousands  of  dollars 
per  year)’'’ 

25%  Increment  Programs 

Alternative  I 

$ 810 

($36,623) 

Alternative  II 

703 

(111,908) 

Alternative  III 

(11,364) 

6,860 

Alternative  IV 

387 

(6,875) 

50%  Increment  Programs 

Alternative  I 

(10,554) 

(29,763) 

Alternative  II 

1,197 

(43,498) 

Alternative  III 

(10,661) 

(105,048) 

Alternative  IV 

1,090 

(118,783) 

Alternative  V 

(10,977) 

(15) 

757,  Increment  Programs 

Alternative  I 

(9,938) 

(104,409) 

Alternative  II 

1,813 

(118,144) 

Alternative  III 

(10,254) 

625 

Alternative  IV 

(10,361) 

(74,661) 

1007.  Increment  Programs 

(9,551) 

(111,284) 

In  these  cases,  investment  and  O&MN  cost  changes  have  been  considered 
separately.  A combined  MOE  such  as  life-cycle  cost  could  also  be  con- 
sidered. 

Parenthesis  indicate  decreases  in  annual  costs. 


EXPECTED  MOE  VALUES  FOR  THE  SELECTED  BUDGETS  AND  ALTERNATIVES 
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For  the  50%  Increment  Program,  no  alternative  dominates  another  in 
preference  for  all  MOEs.  Alternative  IV  dominates  all  other  alternatives 
in  four  out  of  the  six  MOEs,  and  shows  a large  improvement  in  & R^. 

Although  it  dominates  only  two  out  of  the  remaining  four  alternatives  in 
R , ne^-t*ier  increases  nor  decreases  this  response  time.  It  is  pri- 
marily in  0^  that  IV  does  not  perform  well.  However,  the  fact  that 
savings  in  CQMN  are  about  10  times  the  best  savings  in  C^,  argues  that 
Alternative  IV  would  be  ranked  high.  If  we  compare  III  to  I,  we  get  a 
significantly  larger  improvement  in  C^^  f°r  III,  about  equal  performance 
in  R^,  Rp,  and  C^,  and  significant  improvement  in  R^  for  III.  Alterna- 
tive III  does  not  perform  as  well  as  I in  R^>  however,  the  magnitudes 
in  response  time  improvements  are  not  that  large.  We  may  then  argue 
that  III  would  probably  be  preferred  to  I.  Comparing  II  to  V,  II  per- 
forms better  in  all  but  C^..  However,  in  total  dollar  savings  (C^.  + 

Cqmn) ’ ^ Performs  better  than  V.  Thus,  we  might  argue  for  preference 
of  II  over  V.  At  this  point,  II,  III,  and  IV  appear  to  be  the  set  of 
potentially  higher-ranking  alternatives.  Finally,  comparing  II  to  III, 
we  see  that  III  performs  significantly  better  in  dollar  savings,  while 
II  performs  significantly  better  in  R^.  The  relative  importance  of  im- 
provement in  R^  versus  dollar  savings  might  be  the  determining  factor 
between  II  and  III.  We  assume  the  Rp  is  more  important  in  this  case  and 
argue  for  II.  Thus,  Alternatives  II  and  IV  appear  to  be  likely  starting 
candidates  for  application  of  the  method  to  the  50%  Increment  Program 
case. 

Finally,  for  the  75%  Increment  Program,  again  no  alternative  domi- 
nates another  in  preference  for  all  MOEs.  Comparing  II  to  all  other 
alternatives  shows  that  II  dominates  in  all  MOEs  except  C^.,  However, 

the  large  savings  in  C__T,  and  the  fact  that  the  sum  of  CT  and  C-„„.  for 

OMN  I OMN 

II  dominates  all  other  alternatives,  argues  for  the  selection  of  II  as 
the  a-priori  most  preferred.  Comparing  III  to  IV,  we  see  that  IV  domi- 
nates or  equals  III  in  all  but  R . The  large  savings  in  CQMN  for  IV 
when  compared  with  the  magnitude  of  improvement  in  R^  for  HI  would 
argue  for  selection  of  IV  over  III,  Comparing  I to  IV  shows  that  IV 
dominates  in  four  out  of  six  MOEs,  and  has  a significantly  larger 


improvement  in  R^  compared  to  I.  The  dominance  of  I over  IV  in  C is 
u QMN 

not  strong  on  a percentage  improvement  basis,  although  the  magnitude  of 
the  difference  in  savings  is  substantial  («$25M).  Arguing  as  before 
that  improving  R^  may  be  relatively  more  important  than  improving 
leads  to  a tentative  ranking  of  IV  over  I.  Thus,  we  arrive  at  II  and  IV 
as  the  likely  starting  candidates  for  Step  1 in  the  method. 

These  tentative  choices,  for  each  budget,  are  marked  in  Table  V-12 
with  an  asterisk. 

Proceeding  to  Step  2,  for  the  25%  Increment  Program  case,  we  observe 
that  Alternative  I dominates  II  in  two  MOEs  (R  and  > while  II  domi- 
nates I in  three  MOEs  (R^,  C^,  and  C0MN)*  Both  alternatives  are  equal 
in  R . The  MOEs  will  thus  be  reordered  with  R and  R in  the  first  two 
positions.  The  relative  order  between  R and  R can  be  selected  on  the 

basis  of  other  criteria.  For  example,  since  R. , and  RA „ are  for  similar 

A1  A2 

scenarios,  we  may  perform  the  reordering  so  that  these  MOEs  are  conse- 
cutive, and  will  be  involved  in  one  of  the  tradeoff  assessments  to  come. 
Thus,  we  reorder  these  MOEs  in  the  following  sequence:  RQ,  R^,  R^, 

CI*  COMN’  and  V 

Step  3 consists  of  constructing  the  tradeoff  assessment  tableau, 
and  this  is  shown  for  Alternatives  I and  II  in  Table  V-13.  A minimum 
of  one  tradeoff  assessment  will  be  required  to  determine  preference  be- 
tween I and  II.  This  can  be  seen  by  considering  the  hypothetical  alter- 
native I ' and  the  DMs  response  to  be  inserted  in  the  blank  box  for  MOE 
R^2*  If  ARa2  i-s  greater  than  0,  then  II  is  indifferent  to  l'  in  RQ  and 
R^,  but  dominates  in  all  remaining  MOEs.  Thus,  II  is  preferred  to  I' 
and  must  also  be  preferred  to  I.  If  AR.9  is  exactly  0,  then  II  will 
still  dominate  I'  in  3 out  of  6 MOEs  and  be  indifferent  in  the  other  3. 
Thus,  again  II  is  preferred  to  I, 


On  the  other  hand,  if  a number  less  than  0 is  required  for  MOE  R , 

nZ 

we  cannot  yet  determine  preference  between  the  alternatives,  and  must 

proceed  to  at  least  one  more  tradeoff  assessment.  In  any  case  after  at 

most  four  tradeoff  assessments  we  will  be  able  to  determine  the  DMs 

preference  by  comparing  the  value  of  MOE  C„.„,  for  l' ' ' ' to  that  for  II. 

OMN 
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MOE  R does  not  enter  into  the  preference  assessment  between  I and  II, 
since  it  is  equal  for  both. 

Tables  V-14  and  V-15  show  the  initial  tableaus  for  the  507,  Incre- 
ment Program  and  75%  Increment  Program,  respectively.  For  the  50%  In- 
crement Program,  R^  again  does  not  enter  into  preference  assessment  be- 
tween II  and  IV.  The  minimum  and  maximum  number  of  tradeoff  assessments 
required  are  one  and  four,  respectively. 

For  the  75%  Increment  Program,  we  see  that  all  MOEs  must  be  con- 
sidered in  the  preference  assessment.  Since  Alternative  II  dominates 
IV  in  all  but  one  MOE,  at  least  one  tradeoff  assessment  and  at  most  five 
tradeoff  assessments  will  be  required. 

The  next  step  in  the  procedure,  Step  4,  consists  of  asking  the  DM 
to  assess  his  tradeoffs  between  pairs  of  MOE  for  two  distinct  alterna- 
tives. For  example,  the  first  pair  of  MOEs  to  consider  for  the  25%  In- 
crement Program  case  (Table  V-13)  is  response  time  in  the  UNREP  scenario, 

R , and  response  time  in  the  repair-at-sea  scenario,  R . We  are  asking 

L)  n4 

the  DM  to  complete  the  construction  of  Alternative  I'  by  providing  a * 

value  for  AR^  such  that  he  will  be  indifferent  to  I and  I/. 


We  ask  the  DM  to  consider  the  values  of  the  remaining  four  MOEs 
(AR^,  ACj,  ACq^,  and  AR^),  which  are  the  same  for  I and  I'.  Given 
those  values,  we  next  ask  the  DM  to  consider  an  increase  in  the  UNREP 
scenario  response  time  of  0.8  hours,  so  that  the  net  decrease  in  response 
time  changes  from  -3.2  hours  to  -2.4  hours.  The  question  is  what  amount 
of  decrease  in  response  time  in  the  repair-at-sea  scenario  will  compen- 
sate for  the  increase  in  AR_?  There  is  a limit  to  the  amount  that  AR. - 

D A2 

can  be  decreased.  This  limit  corresponds  to  the  point  where  R £ reaches 
zero  and  for  this  case  corresponds  to  the  value  of  R shown  in  Table 

Ac 

V-5,  the  Base  Program  response  time.  Thus,  we  are  asking  the  value  of 
AR^  between  -13.2  and  -118.5  minutes  that  will  compensate  for  a change 
in  ARp  from  -3.2  to  -2.4  hours.  Let  us  assume  that  the  response  is 
-21  minutes.  This  updates  Table  V-13  to  the  values  shown  in  Table  V-16. 

After  each  response  evoked  from  the  DM,  his  rationale  for  his  re- 
sponse should  be  recorded.  In  this  particular  case,  he  may  argue  that 
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an  UNREP  response  time  decrease  significantly  greater  than  2 to  3 hours 
is  needed.  At  these  lower  levels,  an  improvement  in  response  time  of 
about  one  hour  will  not  be  very  significant  in  improving  Naval  readiness. 
On  the  other  hand,  a change  in  response  time  of  one  hour  would  be  con- 
siderably more  significant  in  the  repair-at-sea  scenario.  Thus,  for  each 
hour  of  response  time  given  up  in  Scenario  D,  only  10  minutes  of  improve- 
ment in  response  time  in  Scenario  A is  required  to  compensate.  Thus,  for 

a 0.8-hour  increase  in  ARQ  only  an  8-minute  decrease  in  AR^  *-s  required, 
and  AR^2  should  go  from  -13.2  to  about  -21  minutes. 

Since  the  minimum  number  of  tradeoff  assessment  have  been  accom- 
plished, Step  5 consists  of  comparing  Alternative  II  to  I'.  We  see  that 
II  dominates  or  equals  1'  in  all  MOEs  except  R Thus>  additional 
tradeoff  assessments  will  be  required  to  establish  preference.  Note 
that  if  the  last  DMs  response  had  been  0 minutes  or  more,  we  would  be 

able  to  conclude  that  II  was  preferred  to  I'  and  thus  also  preferred 

to  I . We  would  then  proceed  to  Step  1 or  Step  6 at  the  option  of  the 
DM.  In  this  case,  however,  we  return  to  Step  4. 

The  next  tradeoff  assessment  required  is  between  R and  R^,  the 
small  parts  requisition  scenario.  Here  we  ask  how  much  should  AR^  be 
decreased  to  compensate  for  a AR  increase  from  -21  to  0?  If  the  DM 
considers  one  minute  lost  in  Scenario  A 2 to  be  equivalent  to  3 minutes 
of  gain  in  Scenario  Al,  his  response  will  be  to  change  AR^  from  0 to  -63 
minutes.  This  result  updates  the  tableau  from  that  in  Table  V-16  to 
that  in  Table  V-17. 

Continuing  through  this  process  we  finally  arrive  at  the  final  up- 
dated tableau  shown  in  Table  V-18.  For  the  final  two  tradeoff  assess- 
ments we  have  assumed  that  the  tradeoff  ratio  between  C and  RA , was 

I Al 

-0.17  $M/minute,  while  between  and  CT  it  was  -1.5  $M/$M.  At  this 

OMN  i 

point,  we  note  that  Alternative  II  dominates  I' ' ' ' in  C and  is  equal 

OMN 

in  all  other  MOEs.  Thus,  we  conclude  that  II  is  preferred  to  I.  Re- 
viewing the  MOE  values  for  I and  II  in  Table  V-18,  we  see  that  the  pri- 
mary tradeoff  was  between  an  additional  savings  of  $75  M and  a 

reduced  time  R. , of  60  minutes  for  II  versus  an  additional  reduced 
Al 

time  R^  of  0.8  hours  and  a reduced  response  time  R £ of  about  13  minutes 


6b  IV) 


for  I.  The  large  savings  predominated  for  the  tradeoff  ratios  se- 

lected for  this  example. 

Step  7,  an  optional  step,  consists  of  expanding  the  tableau  to  in- 
clude a tradeoff  assessment  between  MOE  CL._,  and  R_.  This  provides  one 

OMN  C 

more  hypothetical  alternative  and  completes  the  set  of  tradeoff  ratios 

involving  all  of  the  MOEs.  From  these  tradeoff  ratios  the  Y ,'s  in 

ni 

Eq.  (III-13)  can  be  determined.  These  represent  the  implied  tradeoff 
ratios  between  the  last  MOF.  in  Table  V-18  and  each  of  the  other  MOEs. 
The  Y^'s  (where  n = 6)  can  be  computed  recursively  from 


i+1 

y Y 

6i  6xi  6(i+l) 


i = 5,  4,  3,  2,  1 


(V-l) 


where  Y = 1,  and  x^  corresponds  to  the  MOE  in  the  i-th  column  of  Ta- 
ble V-18. 

Since  negative  changes  in  response  time  and  costs  are  preferred  to 
positive  changes,  to  rank  all  alternatives  we  must  minimize  Eq.  (III-13). 

To  pursue  this  example,  let  us  assume  that  for  every  $1M  savings  in 
^OMN’  t*16  is  to  aH°w  Kg  to  increase  by  5 minutes.  This  means 

that  his  tradeoff  ratio  is  given  by 


= -5  min/$M 


(V-  2) 


The  values  of  Y^,  Ax^,  Y ^Ax^,  anc*  f°r  each  1 and  each  alter- 

native are  shown  in  Table  V-19.  From  this  table  we  see  that  indeed  g for 
II  is  less  than  g for  I.  However,  the  minimum  value  of  g is  given  for 
Alternative  IV.  Thus,  IV  may  be  the  irost  preferred  alternative.  Note 
the  poor  relative  performance  of  III.  Reviewing  each  alternative  we  see 
that  the  primary  factor  in  the  performance  of  IV  in  in  ARq.  It  performs 
more  poorly  than  III  in  costs,  but  not  by  very  much.  However,  it  per- 
forms better  than  III  in  all  other  MOEs.  Alternatives  I and  II  perform 
significantly  better  than  III  in  combined  costs,  and  in  all  other  MOEs. 
Thus,  III  scores  lowest  among  all  alternatives.  The  tentative  relative 
ranking  of  all  four  alternatives  is  at  IV  > II  > I > III. 


I 


Table  V-19 
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In  Step  8 we  must  ascertain  whether  the  DM  feels  that  his  tradeoff 
ratios  would  remain  constant  over  the  range  of  MOE  values  indicated  for 
the  four  alternatives.  If  the  DM  response  is  yes,  then  we  infer  that  the 
most  preferred  alternative  is  IV,  the  one  that  minimized  the  linear  func-  > 

tion  given  by  Eq.  (ITI-13),  and  the  relative  ranking  of  all  alternatives 
is  given  above. 

If  the  DM  responds  that  several  of  his  tradeoff  ratios  may  change, 
depending  on  the  magnitudes  of  the  MOEs,  we  would  proceed  to  Step  2 with 
Alternatives  II  and  IV  since  II  is  preferred  to  I,  and  IV  may  be  preferred 
to  II  according  the  DM's  previous  tradeoffs.  The  true  relative  ranking 
between  II  and  IV  will  be  determined  after  the  next  iteration  through  the 
procedure  steps.  The  new  tableau  for  II  and  IV  is  shown  in  Table  V-20. 

The  numerical  example  is  not  carried  out  further  since  the  primary 
objective  of  illustrating  the  procedures  of  the  method  has  been  accom- 
plished. Succeeding  iterations  ensure  that  eventually  all  alternatives 
are  ranked.  At  the  completion  of  this  process,  the  responses  and  rationale 
for  each  step  can  be  reviewed.  Consistency  can  be  checked  by  reordering 
MOEs  and  performing  new  tradeoff  assessments. 

A new  calculation  of  the  Y ^'s  should  give  results  consistent  with 
other  previous  calculations.  Some  inconsistencies  are  bound  to  be  ob- 
served. If  these  are  significant  enough  to  affect  the  final  ranking  of 
the  alternatives,  the  inconsistencies  should  be  resolved.  This  resolu- 
tion will  generally  be  accomplished  by  modifying  one  or  several  tradeoff 
assessment  responses. 

Finally,  we  can  observe  that  in  formulating  the  initial  set  of  alter- 
native programs,  not  all  possible  combinations  or  levels  of  project  funding 
are  included.  After  the  application  of  the  tradeoff  Assessment  procedures, 
the  staff  acquires  an  appreciable  amount  of  information  on  the  DM's  judg- 
mental tradeoffs.  This  can  be  used  as  a basis  for  reviewing  other  alter- 
native possibilities  and  perhaps  adjusting  them  to  obtain  an  improved 
alternative.  In  addition,  the  information  can  also  form  the  basis  for 
constructing  new  alternatives  when  budget  changes  occur,  or  new  planning 
cycles  begin. 
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Appendix  A 

A MATHEMATICAL  MODEL  FOR  THE  RESOURCE  ALLOCATION  METHOD 

The  resource  allocation  (RA)  methodology  is  based  on  the  assumption 
that  there  exists  a "preference"  or  "utility"  function  f that  assigns  a 
real  value  to  each  multi-attribute  outcome.  A multi-attribute  outcome 
is  a set  of  distinct  and  different  outcomes  that  each  have  an  influence 
on  the  preferences  of  the  decision  maker  (DM).  Each  individual  outcome 
is  an  attribute  or  measure  of  effectiveness  (MOE)  of  an  exploratory  devel- 
opment program.  Mathematically,  an  outcome  x is  defined  as  a vector  whose 
components  consist  of  the  set  of  MOEs.  Thus, 


x = (xlf  x2,  x3,  ....  xn) 


(A-l) 


where  x^  is  the  i-th  attribute  variable. 

The  preference  function  f can  then  be  written  as 


f(x)  = f (Xj^ , x2,  x3 xr) 


(A-2) 


This  function  is  such  that  if  one  outcome  vector  x is  preferred  to  another 
outcome  vector  y,  then  f(x)  is  greater  than  f(y),  and  if  neither  is  pre- 
ferred to  the  other,  then  f(x)  equals  f(y). 

Starting  with  the  general  form  of  Eq.  (A-2),  we  will  develop  a mathe- 
matical model  of  the  tradeoff  assessment  process  employed  in  the  RA  meth- 
odology described  in  Section  III.  Let  a be  a specific  value  of  the  vector 
x.  We  can  form  a Taylor  series  expansion  of  the  function  f about  the 
point  a.  If  we  ignore  quadratic  and  higher-order  terms  we  obtain 


11 

f (x)  f (a)  + ^ (xt  - at) 


(A-3) 


The  slope  interpretation  is  illustrated  in  Figure  A-l  for  a two- 
dimensional  case  (n  = 2).  The  three  curves  in  Figure  A-l  are  contours 
of  iso-preference  or  indifference  curves.  The  attributes  are  such  that 
increasing  values  are  preferred,  and  thus  the  preference  function  value 
Increases  in  the  upper  right-hand  direction.  The  point  a lies  on  the 
curve  for  which  f(x)  = f(a).  The  tangent  line  to  the  curve  at  a have 
the  same  slope  as  the  curve,  and  it  is  given  by  -X. (a) . 


FIGURE  A-1  INCREMENTAL  TRADEOFF  RATIO  SLOPE 


If  we  now  consider  two  points  a and  b such  that  f(b)  = f(a),  then 
the  ratio  of  (a^  - b^)  to  (b^  - a^)— call  it  Y^ — gives  the  value  of  X^ 
at  some  intermediate  point  c on  the  same  indifference  curve.  This  is 
illustrated  in  Figure  A-2.  The  value  of  Y^  is  exactly  the  ratio  we  ob- 
from  the  DM's  tradeoff  between  two  outcome  vectors  a and  b that  differ 
in  only  two  attributes.  For  well-behaved  indifference  curves,  such  as 
those  shown,  Y^  will  be  a good  approximation  of  X^  at  a or  b. 

From  these  considerations,  we  see  that  Eq.  (A-6)  can  be  written  for 
the  two-dimensional  case  as 

f(x)  = f(c)  + [ Y1(a,  b)(Xi  - cp  + (x2  - c2)]  (A-7) 

n 

where  Y^(a,  b)  indicates  that  tradeoffs  between  a and  b establish  the 
ratio  Y^.  If  Eq.  (A-7)  were  an  exact  expression  for  the  preference  func- 
tion, we  now  have  enough  information  from  the  DM  to  select  a most  preferred 
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f(a)  = f(b)  = f(c) 


SLOPE  - -X, 


FIGURE  A-2  DECISION  MAKER'S  TRADEOFF  SLOPE 

outcome  from  any  set  of  alternate  outcomes.  To  maximize  f(x)  we  need  only 
select  the  x,  from  the  feasible  set  of  x's,  that  maximizes 


g(x)  = xL  Y^a,  b)  + x2 


(A-8) 


(The  terms  in  the  right-hand  side  of  Eq.  (A-8)  are  the  only  terms  in  the 

right-hand  side  of  Eq.  (A-7)  that  depend  on  x.)  Equation  (A-8)  indicates 

that  the  point  c,  f(c),  and  need  not  be  known  to  solve  the  maximiza- 

oxn 

tion  problem. 


Maximizing  Eq.  (A-8)  is  shown  graphically  in  Figure  A-3.  We  simply 
slide  the  tradeoff  line  up  to  the  right  until  we  have  swept  by  all  but 
one  feasible  outcome.  This  outcome,  e,  maximizes  Eqs.  (A-8)  and  (A-7). 

In  case  Eq.  (A-7)  is  not  exact,  the  feasible  outcome  maximizing  Eq.  (A-8) 


A 


FIGURE  A-3  MAXIMIZING  THE  LINEAR  FUNCTION 


is  still  likely  to  be  most  preferred  and  should  be  selected  as  one  of  the 
pair  of  outcomes  for  the  next  iteration  of  preference  assessments. 

The  above  analysis  can  be  generalized  to  higher-dimensional  problems 
as  follows.  First,  we  generalize  the  incremental  tradeoff  ratio  to  in- 
clude tradeoffs  between  any  pair  of  attributes  xi  and  x.,  where  1 £ n and 
j £ n.  Thus,  let 


Va)  ' " ST 


(A-9) 


f (x)=f (a) 


where  X^Ca)  = and  ^ni(a)  is  equal  to  ^(a)  defined  by  Eq.  (A-5) . It 


can  be  shown  that 


>,,<*>  - fi 

k=i 


\k+l)k(a) 


(A-10) 


Equation  (A-10)  states  that  we  can  obtain  the  tradeoff  ratios  between  any 
two  attributes  as  the  product  of  tradeoff  ratios  between  adjacent  attri- 
butes . 


Similarly,  the  tradeoff  ratios  between  attributes  for  outcome  pairs, 
the  Y's,  can  be  generalized  by  first  defining  the  concept  of  attribute 
linking  pairs  of  outcomes.  Thus,  let  a1  and  a^  be  two  outcome  vectors 
all  of  whose  attribute  values,  except  the  i-th  and  j-th  attributes,  are 
equal , and  whose  i and  j attribute  values  are  such  that  the  DM  is  indif- 
ferent between  a1  and  a . We  then  define 


Y.^,  a1)  = 


a1  - aj 

= _J i 

i i 

ai  ' ai 


(A-ll) 


f (x)=constant 

The  notation  in  Eq.  (A-ll)  is  cumbersome,  but  the  idea  is  simple.  The 
numerator  is  simply  the  difference  between  the  j-th  attribute  values  for 
the  attribute  linking  pair  of  vectors  a^  and  a\  The  denominator  is  the 
difference  between  the  i-th  attribute  values  for  the  same  vector  pair 
(taken  in  reverse  order).  When  the  DM  is  indifferent  between  the  attri- 
bute linking  pairs  of  outcome  vectors,  Eq.  (A-ll)  is  exactly  the  tradeoff 
information  obtained  from  the  DM  tradeoff  assessments,  and  the  attribute- 
linking outcome  pairs  are  the  pairs  of  hypothetical  outcomes  constructed 
in  the  process. 

The  expression  for  Y . in  terms  of  Y..  ......  for  various  values  of  k 

r m (k+l)k 

is  exactly  the  same  form  as  Eq.  (A-10) , but  Y^^  is  a function  cf  a sequence 
of  outcome  vectors  made  up  of  attribute  linking  pairs: 

n-1 


Vni(a  , .. 


al+1,  a1)  = ]”[ 
k=i 


v . k+1  k. 

Y(k+l)k(a  ’ a ) 


(A-12) 


The  equation  for  f(x)  becomes 


4i 
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f(x)  = f (c)  + 


df  (c) 
dx 

n 


Vni(xi  “ Ci> 


i=l 


(A-13) 


where  the  functional  dependence  of  Y^  on  the  set  of  attribute-linking 
vector  pairs  has  been  suppressed  to  ease  the  notation  problem. 

Equation  (A-13)  can  be  interpreted  in  the  following  way.  The  dot 
product  of  the  Y-vector  and  the  outcome  vector,  (x  - c) , set  equal  to  a 
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constant  is  the  equation  of  a hyperplane  in  the  n-dimensional  space  of 
attributes.  [This  dot  produce  is  given  by  the  summation  term  on  the 
right-hand  side  of  Eq.  (A-13).]  Similarly,  the  \-vector  dot  product  with 
the  outcome  vector,  x - c,  is  also  a hyperplane.  The  Y-hyperplane  is  a 
tangent  plane  to  the  indifference  hypersurface  in  n-dimensional  space  at 
some  point  c.  The  point  c is  that  point  for  which  the  Y-hyperplane  con- 
taining the  n outcome  vectors  at  which  the  Y's  were  determined,  is  par- 
allel to  the  X-hyperplane.  Note  that  the  n outcome  vectors  lie  on  the 
same  indifference  hypersurface  as  c.  Thus,  Eq.  (A-13)  is  a linear  model 
for  f(x)  in  the  neighborhood  of  c. 

As  before,  to  select  a feasible  outcome  vector  for  the  next  iteration 
of  tradeoff  assessments  we  maximize  the  function 

n 

8 00  = ^ Yni  xi  • (A- 14) 

i=l 

function  is  independent  of  c,  and  f(c),  so  that  c does 

be  determined  explicitly.  n 


Again,  this 
not  need  to 
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AN  SR-52  PROGRAM  FOR  COMPUTING  EXPECTED  RESPONSE  TIME 
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Appendix  B 

AN  SR-52  PROGRAM  FOR  COMPUTING  EXPECTED  RESPONSE  TIME 

To  facilitate  the  calculation  of  expected  response  times  according 
to  the  model  presented  in  Section  IV-A,  a program  was  written  for  the 
Texas  Instruments  SR-52  hand  calculator.  Memory  locations  00  through  19, 
and  98  and  99  are  used  to  store  the  responsiveness  parameters  according 
to  the  order  shown  in  Table  V-2.  Note  that  the  sums  of  several  responsive- 
ness parameters  are  stored  in  certain  locations. 

The  parameter  values  for  each  case  can  either  be  input  by  hand  or 
stored  on  a second  magnetic  card  as  a program  to  load  the  memory.  This 
works  only  for  loading  memory  locations  00  through  19.  Locations  98  and 
99  must  be  loaded  by  hand  after  running  the  program  that  loads  00  through 
19. 
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